Code Monkey home page Code Monkey logo

afs2-model's Introduction

AFS2-MODEL SDK

Documentation Status Build Status

Documents

Reference documents Readthedocs

Installation

Support python version 3.6 or later

pip install on AFS notebook

AFS provides the release version SDK on private pypi server. Run the following command on notebook cell to install SDK:

!pip install afs2-model

List the installed packages.

Develop

(For SDK developer) From sources

  1. Clone the repository to local.

  2. To build the library run:

$ python setup.py install

(For SDK developer) Build from source

  1. Clone the repository to local.

  2. To build the wheel package:

$ python setup.py bdist_wheel
  1. .whl will be in dist/

afs2-model's People

Contributors

benchuang11046 avatar chenjr0719 avatar owen198 avatar

Stargazers

 avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar

afs2-model's Issues

Switch from requests to aiohttp

Because afs-sdk is part of afs_server's dependency, and afs_server is based on asyncio related modules. And, the most regrettable part is, requests is not support asyncio currently, so, can we switch from requests to aiohttp?

Deprecate v1 related operations

Since the AFS server is already moved to v2 APIs, I think we can deprecate v1 related operations. Add deprecated warnings at this or next version, and really deprecate all v1 operations after the re-implement is done.

About afs2-model on PyPI.org

afs2-model is scheduled to on pypi.org 4/29
The reason is WISE-PaaS private pypi server will be shutdown the same day.
Due to many users are develop the old usage on WISE-PaaS, and they will have some checkpoints soon.
The next version 2.1.13 will be just fix the package name, and the usage is the same as before.
I thank @chenjr0719 to give a advanced AFS SDK, and I have already fixed the package name and usage case. It will be appeared in version 2.2. And I will prepared more friendly docs to our users.

pip install failed

Dear Ben:

For pip >= 10, from pip.req import parse_requirements in setup.py will import failed.

Please reference this to make fix this issue.

thanks

Integrate with Travis CI and Codecov?

How about integrating Travis CI and Codecov to get a better development experience? Here is an example after integrating Travis CI and Codecov.
Once the new PR has been sent, the Travis CI will run unit tests and generate coverage report about this PR. The report will be hosted on Codecov and it also reports the coverage status to the PR. This can help us to check how the PR influence our project. Any idea?

v2.2 user manual enhanced

v2.2 has some new documents to user, about RESTful API parameters and stauts code.

  • [docs] API return status code
  • [docs] model repository API parameters introduction
  • [docs] models API parameters introduction

Upload model has a bottleneck on the big model transferring

The bottleneck of uploading is about 500-600MB on private cloud.(Maybe less on public cloud)
Currently, the uploading model file is going to api-afs and written to blob.
It may cause timeout when transferring the big file.
I want to add a function to update model to blob directly.

# training... 
# produce model...
...

# afs2-model DO NOT upload 
afs2_model.upload_model(...)

# Model file on blob is models/{instance_id}/{model_respository_id}/{model_id}
# User should input their blob_credential
# Check existed file on the blob and update the big model to the blob directly
# Notify api-afs this operation success/failed
afs2_model.update_model_to_blob(blob_credential, model_file)

models method upload_model support v2

There will have v2 AFS API, so SDK have to support v2.
First, we support models.upload_model and the depending method.
I will write the unit test.

For public pypi name

The name afs is already registered package name in pypi.
If the project goes on pypi, it will be renamed.

Add tox support

To verify the module work with different versions of python, I want to integrate tox into tests. Also wants to add some lint support in tox.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.