Comments (7)
@formath src/linear/run_yarn.sh is not ok?
from difacto_dmlc.
@CNevd I can't find "guide/demo_hdfs.conf" in run_yarn.sh. Is this configure file the hdfs-site.conf?
from difacto_dmlc.
@formath guide/demo_hdfs.conf is generated by
cat <<< " train_data = \"hdfs://${hdfs_dir}/data/agaricus.txt.train\" val_data = \"hdfs://${hdfs_dir}/data/agaricus.txt.test\" max_data_pass = 3 " >guide/demo_hdfs.conf
or you can write your own .conf
from difacto_dmlc.
@CNevd Yeah. It's simple to use. But I still want to know could linear in this project support millions features and instances? If based on ps-lite, I think it will be.
from difacto_dmlc.
yes, it supports, we use linear and difacto for millions features and 10~100 millions instances
from difacto_dmlc.
@CNevd Great job. The original project of difacto does't support distributed training. Is this project support that? What is the main difference against the original project?
from difacto_dmlc.
it supports distributed training, this project is extract from wormhole/learn/difacto which is the first version of difacto
from difacto_dmlc.
Related Issues (20)
- should '--server-nodes' be '--server_nodes' in dmlc_yarn.py? HOT 8
- Difacto_DMLC's installation become Wrong HOT 2
- sh run_local.sh become Wrong!!! HOT 5
- dump bug HOT 2
- problem when model file have more than one part HOT 6
- New function is needed HOT 4
- Difacto_DMLC 如何支持 分布式执行 HOT 2
- run_local wrong HOT 1
- run_yarn.sh fail: Timeout (500 sec) to wait all other nodes initialized. See commmets for more information HOT 14
- The newest HDFS viewfs schema support
- run_yarn.sh fail HOT 1
- cool work, do you have plan to update dmlc-core and ps-lite, and put all ps-based algorithm together HOT 1
- GLIBC_2.14
- how to fix run_yarn.sh python error HOT 1
- how to set multiple hdfs training data path HOT 2
- L1L2 has not effect on auc HOT 3
- How the training or prediction be started? HOT 3
- Some confusion about use dump.cc to dump a readable model HOT 3
- Problem of reading data HOT 17
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from difacto_dmlc.