Code Monkey home page Code Monkey logo

Comments (5)

jackolney avatar jackolney commented on August 20, 2024

Can I suggest something akin to jackolney/clustr? This will now work easily for others and wraps around didehpc (just noticed the name change, nice)

clustr allows:

  • Automatic login from ~/.smbcredentials (if present)
  • Simplified selection of cluster: "MRC" or "DIDE" vs. fi--didemrchnb or fi--dideclusthn
  • All packages named in one vector e.g. packages = c("devtools", "hadley/ggplot2") and they will be teased apart into those required from CRAN / GitHub
  • All done with one function call to login

from didehpc.

richfitz avatar richfitz commented on August 20, 2024

Hmm, not sure.

  • installation of the core tools should now be as simple as: source("https://dide-tools.github.io/didehpc/install") (don't run that unless you want to upgrade, in which case check the porting guide. Particularly, I cannot recommend devtools::install_github because of the mess that it regularly leaves windows machines in (I see you're using it within your login function
  • I like the idea of cluster name aliasing - I'll add that to the main package. The headnode names are used elsewhere though so I'll need to keep them as an option
  • after things are generally working the first time, web_login() should not be explicitly needed. The new version also attempts to detect if it can avoid re-requesting a password
  • The global config options I am now (finally) officially setting via .Rprofile

The package specification thing I explicitly moved away from - I'd used this previously and it eventually falls short, not least because determining the package name from a github repo is depressingly not always straightforward

from didehpc.

richfitz avatar richfitz commented on August 20, 2024

I'm thinking that an ask based interface might be nice, but it involves writing to people's .Rprofile - that could be avoided by using startup but then we are building a bit of a chain of dependencies.

from didehpc.

jackolney avatar jackolney commented on August 20, 2024

+1 for the ask based interface - never really seen this type of interface used in R. Only concern would be whether responses can be scripted / automated.

from didehpc.

richfitz avatar richfitz commented on August 20, 2024

That's the issue; they can't really. I need this information to end up in people's .Rprofile files and in the script they're writing but in general don't want to mess around with these too much. Some things like the username stuff will apply all the time, some like cluster will apply most of the time, and others (workers, timeouts, progress bars, etc, etc) will be very project specific

from didehpc.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.