python data transport layer, mongodb, netezza, bigquery, postgresql files
Go to file
Steve Nyemba e8328e577d bug fix 2019-09-17 11:21:42 -05:00
transport bug fix 2019-09-17 11:21:42 -05:00
README.md bug fix 2019-09-17 11:21:42 -05:00
requirements.txt S3 Requirments file 2017-09-26 16:10:14 -05:00
setup.py data transport framework for rabbitmq, mongodb, couchdb, ... 2019-09-16 23:08:43 -05:00
transport.py S3 - Bug fix? Not sure 2017-09-26 15:54:26 -05:00

README.md

Introduction

This project implements an abstraction of objects that can have access to a variety of data stores, implementing read/write functions associated and specific to the data-sources. The classes implement functionalities against :

- Rabbitmq-server
- Couchdb-server
- Http Session : {csv,tab,pipe,sql}
- Disk{Reader|Writer} : csv, tab, pipe, sql on disk

Usage

The basic usage revolves around a factory class (to be a singleton)

import transport
from transport import factory
#
# importing a mongo reader
args = {"host":"<host>:<port>","dbname":"<database>","doc":"<doc_id>",["username":"<username>","password":"<password>"]}
mreader = factory.instance(type='mongo.MonoReader',args=args)
#
# reading a document and executing a view
#
document    = mreader.read()
result      = mreader.view(name)
#
# importing a couchdb reader
args = {"url":"<http://host>:<port>","dbname":"<database>","doc":"<doc_id>","username":"<username>","password":"<password>"}
creader     = factory.instance(type='couch.CouchReader',args=args)

#
# Reading a document and executing a view
#
document    = dreader.read()    
result      = couchdb.view(id='<design_doc_id>',view_name=<view_name',<key=value|keys=values>)