Path: blob/master/recsys/__pycache__/movielens.cpython-35.pyc
2604 views
N��X � @ s~ d d l Z d d l Z d d l Z d d l m Z d d � Z d d � Z e d k rz d Z
e e
� \ Z Z e j
� d S) � N)�callc C s t j j | d � } t j j | � sV t d d d | d g � t d | d g � d d d d
g } t j | d d d
| �} | d j � j d } | d j � j d } t j
| | f � } x; | j d d � D]' } | j | | j
d | j d f <q� W| S)z create movielens rating matrixzu.dataZcurlz-Oz.http://files.grouplens.org/datasets/movielens/z.zipZunzip�user_id�item_id�rating� timestamp�sep� �namesr �indexF� )�os�path�join�isdirr �pd�read_csv�unique�shape�np�zeros�
itertuplesr r r )�file_dir� file_pathr �dfZn_usersZn_items�ratings�row� r �1/Users/ethen/machine-learning/recsys/movielens.py�create_rating_mat s %r c C s� t | � } t j | j � } | j � } xp t | j d � D][ } t j j t j | | � d d d d �} d | | | f <| | | f | | | f <q> Wt j | | d k � s� t
� | | f S)zu
split into training and test sets,
remove 10 ratings from each user
and assign them to the test set
r �size�
�replaceFg ) r r r r �copy�range�random�choice� flatnonzero�all�AssertionError)r r �test�train�userZ
test_indexr r r �create_train_test s r, �__main__zml-100k)r �numpyr �pandasr �
subprocessr r r, �__name__r r* r) �headr r r r �<module> s