Comments (10)
Thanks for your kind works, I know g10k still has some rough edges, but we like the performance increase very much :)
We are using a single server in front of all Puppetservers that runs g10k once and then rsync all Puppet environments to the Puppetservers instead of triggering g10k on each Puppetserver.
Otherwise running almost 100 Puppetserver would/should trigger DDOS protection on the Puppetlabs Forge or github.com anyway, besides wasting resources.
I added limitation of the maximum number of goroutines running for Git/Forge resolving.
Try it out.
https://github.com/xorpaul/g10k/releases/tag/v0.2.8b
db95104
from g10k.
it would have been easier to add options if you used docopt (it exists either for Pytthon and for Go).
from g10k.
it's impressive! With the older version I was able to fetch in 8 seconds, with this new version I am able to fetch in 2 seconds
from g10k.
Wow, are you sure that your not just using the cached Git and Forge modules now?
Was it really the overload of your Gitlab server that slowed down your previous g10k runs?
How many workers are you using right now?
from g10k.
I didn't set the worker limit right now (as I don't have the 2nd puppet server yet), but I played a bit with it and I have seen a strange behavior when I set it to a very low value (a meaningless value, lower than 5).
In this case it throws an error, saying that it cannot connect to my Gitlab server (with the usual error message: please check if you have put you keys... ).
The other difference, is that now I used the binary compiled by you, while in the previous case, I compiled the binary on a RedHat 6 (which means that I surely used some older version of Go).
from g10k.
Hi. I have been working on this:
https://github.com/maxadamo/g10k-webhook (until I decide to move everything on the public Gitlab).
It's a drop-in replacement for r10k_gitlab_webhook, enhanced with a lot of steroids.
it would have been nicer to to it with Go, but it would have taken ages compared to python.
Honestly, I don't understand if it's good for generic use, of if it fits too much my environment.
from g10k.
This would be useful for me too.
from g10k.
I still need to find a bug introduced by db95104 before I can merge it.
For some reason it waits indefinitely for a go routine.
from g10k.
Found the bug, missing waitgroup 19b953d#diff-b112433c20987b983fa33aa1eac9482dR58
Relase: https://github.com/xorpaul/g10k/releases/tag/v0.3.7
from g10k.
Seems like the -maxworker
parameter has never worked.
It should be fixed now with v0.7.1
from g10k.
Related Issues (20)
- possibly unsafe use of /tmp for cache directory
- Distinct SSH keys don't work.
- Distinct SSH keys don't work HOT 8
- Branch filtering doesn't work as expected HOT 7
- Use ssh-agent to get key password HOT 7
- Travis-ci: build is failing on AMD64 HOT 2
- Yaml instead of Puppetfile? HOT 5
- "deploy module" appears to update the entire environment anyway? HOT 4
- retry with `main` as a default branch if `master` is not available HOT 4
- Purge does not work HOT 14
- make `-check4update` work again HOT 1
- Changing a remote's Git URL doesn't update the cache HOT 5
- Deprecation warnings go 17.1
- Deprecation warnings go 17.1 HOT 1
- Can't build g10k for OSX Monterey
- add flag to keep .git directories HOT 3
- -clonegit unexpectedly fails with commit refs HOT 2
- Support git module with both branch and ref specified HOT 2
- forge code does not accept http 200 code without reason
- syncing multiple git sources with same branches fails HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from g10k.