Path: blob/master/input/__pycache__/google_drive_tools.cpython-34.pyc
1306 views
�
�چZ� � @ s� d d l Z d d l Z d d l m Z e � Z e e _ e j d � Z e d Z d d � Z
d d d d � Z d d d
d � Z d d
� Z
d d d d � Z d d � Z d d d d d d d d � Z d S)� N)� ConfigParserz drive.cfg�FILESc C s) t � } t | _ | j d � } | d S)Nz drive.cfgr )r �str� optionxform�read)�cfg�tmp� r �F/home/restrepo/Cursos/ComputationalMethods/input/google_drive_tools.py�load_drive_files_keys
s r c C s d d l } | s% d | | f } n d | | | f } t j | � } | j d k r{ t j | j � } | j | d d �Sd S)a
Read Google spread sheet by id.
Options:
gss_sheet=N : if in old format select the N-sheet
gss_query=SQL_command: Filter with some SQL command
example
SQL_command: 'select B,D,E,F,I where (H contains 'GFIF') order by D desc'
r NzDhttps://docs.google.com/spreadsheets/d/%s/gviz/tq?tqx=out:csv&gid=%szJhttps://docs.google.com/spreadsheets/d/%s/gviz/tq?tqx=out:csv&gid=%s&tq=%s�� �keep_default_naF)�pandas�requests�getZ status_code�io�StringIO�text�read_csv)�id� gss_sheet� gss_query�pd�url�rZcsv_filer r r
� pandas_from_google_drive_csv s r Tc C s� d } t j � } | j | d i | d 6d d �} t | � } | rx i | d 6| d 6} | j | d | d d �} n t | d | d | �S) a�
Download file from google drive as binary (default) or txt file.
If not destination the file object is returned
Example: Let id="XXX" a txt file:
1) fb=download_file_from_google_drive("XXX") ; fb.decode() #to convert to text file
2) ft=download_file_from_google_drive("XXX",binary=False) # txt file
3) fb=download_file_from_google_drive("XXX",'output_file') # always binay
z*https://docs.google.com/uc?export=download�paramsr �streamT�confirm� destination�binary)r �Sessionr �get_confirm_token�save_response_content)r r r �URL�session�response�tokenr r r r
� download_file_from_google_drive' s " r( c C s7 x0 | j j � D] \ } } | j d � r | Sq Wd S)NZdownload_warning)Zcookies�items�
startswith)r& �key�valuer r r
r" > s r" c C s� d } | r t | d � } n d } x@ | j | � D]/ } | r4 | rV | j | � qc | | } q4 q4 W| rz | j � n& | r� t j | � St j | j � � Sd S)Ni � �wb� )�openZ iter_content�write�closer �BytesIOr �decode)r& r r Z
CHUNK_SIZE�f�chunks�chunkr r r
r# E s
r# c K s� d d l } d d l } | j d | � rb t j | � rO t t j | � | � S| j | | � Sn t j | � r� | j t t j | � � | � S| j | | � Sd S)a� Read excel from google drive
Requieres a drive_file dictionary with the keys for the google drive
file names.
If the file_name is not found in the drive_file dictionary it is read locally.
If the file_name have an extension .csv, tray to read the google spreadsheet
directly: check pandas_from_google_drive_csv for passed options
WARNING: ONLY OLD Google Spread Sheet allows to load sheet different from 0
r Nz\.csv$) r �re�search�
drive_filer r r �
read_excelr( )� file_name�kwargsr r7 r r r
�read_drive_excelZ s r= z https://spreadsheets.google.com�csvZ,0AuLa_xuSIEvxdERYSGVQWDBTX1NCN19QMXVpb0lhWXcz:select B,D,E,F,I where (H contains 'GFIF') order by D descFc C sD d d l } d | | | | t | � f } | j | j d d � � S)Nr z$%s/tq?tqx=out:%s&tq=%s&key=%s&gid=%s� �+)r r r �replace)Zgss_urlZ
gss_formatZgss_keyr r Zgss_keep_default_nar Zissn_urlr r r
�query_drive_csvr s rB )r r � configparserr r r r r r r9 r r r( r" r# r= rB r r r r
�<module> s$