Comments (8)
what connection do you mean? Did you notice any bottle neck for your concurrence pulling?
from harbor.
yes ,
we are getting some errors like connection reset by peer , sometimes 502 gateway error and few TLS handshake errors as well
from harbor.
several points that we need to check,
- cpu/memory usage of core, db, registry
- database connection
- the connection reset happens at which phase, it's closed by nginx, distribution or storage.
from harbor.
from harbor.
we are setting such limits to the containers and sometimes CPU and mem for registry will be 100 percent with above restriction
the connection reset happens at which phase, it's closed by nginx, distribution or storage.- connection reset happens between registry and core
from harbor.
What is your installation type docker-compose or harbor helm? Do you have any log information show that connection reset happens between registry and core
?
The connect reset /tls handshake errors should occur in Nginx side.
For the concurrent pull test, you could refer https://github.com/goharbor/perf/wiki
from harbor.
it is docker-compose
024-06-03T10:34:30.621804333+03:00 stderr F 2024/06/03 07:34:30 http: TLS handshake error from 172.17.0.127:37762: read tcp 172.17.0.124:5443->172.17.0.127:37762: read: connection reset by peer
Test scenario:
and each image is of ~250 MB , there are one or two image which is upto 1.5 gb as well .We are testing to download 58 such image from harbor in 20 virtual machines together. So concurrency comes around 1200.
Above testing i see concurrency is 500
is there any concurrency limit from harbor side as well ?
from harbor.
i am also getting this errors as well
image download error
Error: initializing source docker://zxzxzxzx:8443/vduproject/docker-dhcp:4.44.1: Requesting bearer token: invalid status code from registry 504 (Gateway Timeout)
time="2024-05-31T18:14:50+03:00" level=warning msg="Failed, retrying in 1s ... (1/3). Error: parsing image configuration: Get "https://xzxzxzxz/v2/vduproject/oamne3sadapt/blobs/sha256:fe435c56ee3225a1b2ebd34cdf693e37272ec3cc11bcdcda5e537cdf2b196ced\": EOF"
Copying blob sha256:ec7250d0b43078843415b0fc080372d03c48afa27dc48e351d353da5ada6d7c3
Copying blob sha256:cd1d83871e52f65d9d2ac52e7486c0e671b8e6c845ef6760710052a58d7315d1
same error in proxy.log
2024-05-31T18:14:48.928049004+03:00 stdout F 2024/05/31 15:14:48 [error] 7#0: *5336 upstream timed out (110: Connection timed out) while reading response header from upstream, client: xx.xxx.xxx.xx, server: , request: "GET /service/token?account=robot%24vduproject%2Bvdu_user&scope=repository%3Avduproject%2Fdocker-dhcp%3Apull&service=harbor-registry HTTP/1.1", upstream: "https://172.17.0.119:8443/service/token?account=robot%24vduproject%2Bvdu_user&scope=repository%3Avduproject%2Fdocker-dhcp%3Apull&service=harbor-registry", host: "xxxxx:8443"t
[13] 11:46:05 [SUCCESS] sprintlab780vm23
Error: initializing source docker://xxx:8443/vduproject/oamconfig:0.300.22229: reading manifest 0.300.22229 in xxxx:8443/vduproject/oamconfig: received unexpected HTTP status: 502 Bad Gateway
proxy_connect_timeout 600;
proxy_send_timeout 900;
proxy_read_timeout 900;
from harbor.
Related Issues (20)
- Garbage Collection without Harbor GC HOT 1
- [Bug Report] The banner message is causing the search bar to be obscured. HOT 2
- Harbor Retention Policy Rules Fails for Multiple Wildcards Repositories HOT 3
- Bump up helm, ORAS, CNAB, imgpkg, cosign ... version in Harbor 2.12
- Errors found when upgrading Harbor & migrating the database: 'ERROR: function jsonb_path_exists(jsonb, unknown) does not exist' HOT 2
- Scanning related inconsistent UI display issues HOT 1
- loggerSweeperDuration does not clean the /var/log/jobs files. HOT 1
- Enable OpenSSF Scorecard to enhance security practices across the project
- Garbage collection job is constantly in pending status HOT 2
- use nginx proxy HOT 1
- Expose ssl_protocols in harbor.yml to allow users to run harbor with only TLSv1.3 enabled
- docker login failed: login attempt to https://xxx/v2/ failed with status: 401 Unauthorized on v2.10.2 HOT 3
- [Feature Request] A Way to Reduce Quota Consumption for Replication on Docker Hub HOT 7
- panic: bad _REDIS_URL_CORE HOT 3
- persistence.persistentVolumeClaim.trivy.existingClaim can't have value HOT 2
- Referral failure with LDAP auth HOT 1
- package not found HOT 2
- `scan vulnerability` button should not disappear when deactivate a scanner
- duplicate key value violates unique constraint "scan_report_digest_registration_uuid_mime_type_key"
- failures on OIDC users to create robot account in their projects HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from harbor.