lbr38 / repomanager Goto Github PK

Please look into supporting SSO through SAML, Oauth 2.0 or OpenID Connect.

When clicking on one of the operations in the history column, the loading circle is generated on the bottom left, but the page and URL does not update to show the operation and its logs.
Manually grabbing the log name and appending it to this URL does show the log:
http://repomanager.example.com:8080/run?view-logfile=

Issues persists in Chrome and Firefox on Windows 11 and using latest repomanager version.

Hello, I sucessfully install repomanager with docker, but now Im not abble to find out how to add ubuntu focal repo to begin synchronisation with http://archive.ubuntu.com/ubuntu/.

This is in my source list:
deb http://archive.ubuntu.com/ubuntu/ focal main restricted universe multiverse
deb http://security.ubuntu.com/ubuntu/ focal-security main restricted universe multiverse
deb http://archive.ubuntu.com/ubuntu/ focal-updates main restricted universe multiverse

How to configure repomanager to sync all this repos into my docker?

Hi,
Using podman-compose and the repomanager container as such :

  # Repomanager - Gestion des repos linux
  repomanager:
    restart: always
    container_name: repomanager
    hostname: repomanager
    environment:
      - FQDN=repomanager.my.fqdn.fr
      - MAX_UPLOAD_SIZE=32M
    ports:
      - '8080:8080'
    volumes:
      - '/etc/localtime:/etc/localtime:ro'
      - './repomanager/repomanager-data:/var/lib/repomanager'
      - './shared/repomanager-repo:/home/repo'
    image: 'lbr38/repomanager:latest'

My FQDN in container is set to my docker host hostname in the GUI :

So my clients can't reach the repository URL, but maybe it's only a podman issue.

Edit #1 :
If I check the FQDN ENV in container it's correct so it may be a bug :

Is it possible to change the GPG Key ID in the setting page ? When I change it, my repo fail to build because it can't fing the new gpg key. Does auto generate the new key or do I need to provide it and if i need to provide it, where I can place it ?

We are PoCing the solution internally and have run into a blocker where we are unable to upload packages to a local repo.

Packages with the correct MIME type of .deb are failing to be uploaded to repomanager and shown in the image above.
This issue persists in Chrome, Edge and Firefox.

I dug through the codebase and determined that repomanager is relying on the filetype from the browser and based on my investigation of the network traffic to repomanager, it does appear the filetype is wrong:

This was from Windows 11.

Could you add the ability to schedule tasks to run monthly.
I would like to be able to schedule the execution of a task on the last Friday of the month for example.

Thank you for your work.

Sincerely

I think having one mail server is a more popular infrastructure solution.
You can use the configuration like this:

Some of my system has been located in really stricted inbound and outbound policy and only able to access to the world via designate proxy, after dig out through UI seems not able to setup proxy, do I need to setup in php app ?

Few suggestions/observations:
Even with new predefined list is adding new ubuntu repo very confusing for us newbies. When you define new source repo there should be just clearly defined items like debian-10,debian-12, ubuntu-focal, ubuntu-jammi etc, no section or whatever.
If I as end user want to download ubuntu-focal, I want just pickup item ubuntu-focal from predefined list and thats it, no section, no nothing else. Expected result from this should by getting everything you get from default source list in new installation of ubuntu-focal.
Also name convection in RPM section is very conmfusing, there should be Almalinux-8, Almalinux-9. Names like baseos, extras, apstream, updates....as end user I dont have idea what it is, to what it belong and why I needed or if I even needed.
Again name convection should be something like this...Almalinux-9, Almalinux-9-extra. Maybe better Almalinux-9-Full, just give me all for x64. Same as with deb section...I expecting from Almalinux repo to give me all from all default defined repos from default new installation Almalinux.
RM can do much more, but for example for my needs I just want tool where I in simple way define new distro, RM will download it and finally I just define new repos in target installation. Thats it and I guess that this will be main point for majority of potentional interested users.

I'm trying to mirror https://yum.oracle.com/repo/OracleLinux/OL7/latest/x86_64, but the packages are never downloaded (only primary.xml, primary.xml.gz and repomd.xml). From the logs I can see
- Retrieving packages list from /home/repo/download-mirror-ol7-1698133890/primary.xml.gz but it ends there.
Debian 11/12 and Epel works fine without any problems. I've tried rewriting the URL like https://yum.oracle.com/repo/OracleLinux/OL$releasever/latest/$basearch but still no more than the three mentioned files. Any ideas here? Version used is 3.7.3

Hi, hope you are doing good !

I had some issues adding my first external repo (Not in the predefined list) and I'd like to share them with you.
But first I'd like to thank you again for your work as I was not able to find a software like this elsewhere.

That being said here are some thoughts :

1. Firstly, the UI is pretty and looking pretty easy but when you really try to add repos the UX is not that intuitive
2. The Wiki is pretty helpful but the "Adding a new repo" part is lacking some informations IMO
3. The predefined repos worked flawlessly so nothing to say about that
4. It may be intersting to add the possibility to add "distribution" tags in your predefined list using the GUI (Instead of entering it manually)

For the following issues I had, it was with trying to add a Debian 9 (Stretch) repo to repomanager but their may global issues

5. I can't add the GPG key for Stretch (Using URL orl Copy/Pasting it) but it worked using another key for another repo
   
   

6. I encounter some random Curl errors while trying to download repos sometimes but never at the same line, I keep you updated if I manage to find why
   

Hope this can help to improve your software !
Take care,
Cloudkid

Currently the default php.ini size for:

php.ini => upload_max_filesize (must be equal or higher than the file's size you're attempting to upload)

Is rather impractical and small at 2M, by default I would suggest upping this to match the nginx size of 32M.

From 2021/06/14 Ubuntu switched the default compression for dpkg from xz to zstd (CHANGELOG).
I believe this causing my attempts to mirror the Ubuntu 22.04 LTS to fail:

Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/accountsservice_22.07.5-2ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/acct_6.6.4-4build2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/acl_2.3.1-1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/acpi-support_0.144_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/acpid_2.0.33-1ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/adcli_0.9.1-1ubuntu2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/adsys_0.8.4_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/advancecomp_2.1-2.1ubuntu2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/adwaita-icon-theme_41.0-1ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aide_0.17.4-1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aide-common_0.17.4-1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aisleriot_3.22.22-1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/alembic_1.7.6-1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/alsa-topology-conf_1.2.5.1-2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/alsa-ucm-conf_1.2.6.3-1ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/alsa-utils_1.2.6-1ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/amavisd-new_2.12.2-1ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/amd64-microcode_3.20191218.1ubuntu2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/anacron_2.3-31ubuntu2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/anope_2.0.9-1build2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aodh-api_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aodh-common_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aodh-doc_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aodh-evaluator_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aodh-expirer_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aodh-listener_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aodh-notifier_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apache2_2.4.52-1ubuntu4_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apache2-bin_2.4.52-1ubuntu4_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apache2-data_2.4.52-1ubuntu4_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apache2-dev_2.4.52-1ubuntu4_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apache2-doc_2.4.52-1ubuntu4_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apache2-ssl-dev_2.4.52-1ubuntu4_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apache2-utils_2.4.52-1ubuntu4_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apg_2.2.3.dfsg.1-5build2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apparmor_3.0.4-2ubuntu2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apparmor-profiles_3.0.4-2ubuntu2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apparmor-utils_3.0.4-2ubuntu2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apport_2.20.11-0ubuntu82_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apport-gtk_2.20.11-0ubuntu82_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apport-retrace_2.20.11-0ubuntu82_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/appstream_0.15.2-2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apt_2.4.5_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apt-config-icons_0.15.2-2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apt-config-icons-hidpi_0.15.2-2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apt-config-icons-large_0.15.2-2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apt-config-icons-large-hidpi_0.15.2-2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apt-doc_2.4.5_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apt-utils_2.4.5_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aptdaemon_1.1.1+bzr982-0ubuntu39_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aptdaemon-data_1.1.1+bzr982-0ubuntu39_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apturl_0.5.2ubuntu22_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/apturl-common_0.5.2ubuntu22_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aspell_0.60.8-4build1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/aspell-doc_0.60.8-4build1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/at-spi2-core_2.44.0-3_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/at-spi2-doc_2.44.0-3_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/attr_2.5.1-1build1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/auditd_3.0.7-1build1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/authbind_2.1.3build1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/autoconf_2.71-2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/autoconf-doc_2.71-2_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/autodep8_0.25_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/autofs_5.1.8-1ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/automake_1.16.5-1.3_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/autopkgtest_5.20_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/autopoint_0.21-4ubuntu4_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/autotools-dev_20220109.1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/avahi-autoipd_0.8-5ubuntu5_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/avahi-daemon_0.8-5ubuntu5_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/avahi-utils_0.8-5ubuntu5_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/b43-fwcutter_019-7build2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/backuppc_4.4.0-5ubuntu2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/backuppc-rsync_3.1.3.0-3build1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/baobab_41.0-2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/barbican-api_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/barbican-common_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/barbican-doc_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/barbican-keystone-listener_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/barbican-worker_14.0.0-0ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/base-files_12ubuntu4_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/base-passwd_3.5.52build1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bash_5.1-6ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bash-completion_2.11-5ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bash-doc_5.1-6ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bc_1.07.1-3build1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bcache-tools_1.0.8-4ubuntu3_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bcrelay_1.4.0-12build2_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bind9_9.18.1-1ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bind9-dev_9.18.1-1ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bind9-dnsutils_9.18.1-1ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bind9-doc_9.18.1-1ubuntu1_all.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bind9-host_9.18.1-1ubuntu1_amd64.deb'!
Could not find a suitable control.tar file within '/home/repo/ubuntu/jammy/14-11-2023_main/packages/bind9-libs_9.18.1-1ubuntu1_amd64.deb'!
Warning: database 'jammy|main|amd64' was modified but no index file was exported.
Changes will only be visible after the next 'export'!
There have been errors!

Hi all !

Since I started using the container I keep getting a "Getting settings..." message every seconds constantly in container logs, is this a bug or did I just forgot something during deployment ?

Could you please add the build to the debian (or rpm) package. In the future, we may include your own repository for repomanager deployment and updates.

Thank you for your work.

I updated to the latest 3.5.3 and when downloading AlmalInux repo newly predefined from list I get:
Getting repomd.xml from https://ftp.linux.cz/pub/linux/almalinux/repodata/repomd.xml ... File not found error
There is not repodata folder with repomd.xml on this mirror:

Base on what was pick this specific mirror for downloading packages?

Hello. I attempted to split up my repo data "per-distro" as follows:

One disk is mounted to /var/lib/docker/volumes
Another disk is mounted to /var/lib/docker/volumes/repomanager-repo/debian
The plan being to add another disk for the next distro, e.g. /var/lib/docker/volumes/repomanager-repo/centos

This is the error I get after downloading all of the packages:
"Error: Could not rename working directory /home/repo/download-mirror-debian-bookworm-main-1701319569"
The downloaded files are all erased.
I checked the permissions... they were consistent across the various paths.

I am running this on a Centos Stream 9 system with the below docker run command:

docker run -d --restart always --name repomanager \
        -e FQDN=(redacted) \
        -e MAX_UPLOAD_SIZE=32M \
        -p 8080:8080 \
        -v /etc/localtime:/etc/localtime:ro \
        -v /var/lib/docker/volumes/repomanager-data:/var/lib/repomanager \
        -v /var/lib/docker/volumes/repomanager-repo:/home/repo \
        lbr38/repomanager:latest

Please let me know if you have any ideas on this. Thanks for this application! It appears to be exactly what I needed to complete the task at hand, which is staging deployments.

Hi! it would be nice to not only mirror rpms/debs. Is that an option you consider?

Hi

Do you have any plans to support the rsync mirror?

Thanks

there is no settings folder & cant finish install as the promotion saying https://xxx.xxx.xxx.xxx/settings

When trying to upload a DEB package to a local repo, it fails as it complains about a lack of section:

No section given for 'gc-guest-agent', skipping.
Warning: database 'focal|main|amd64' was modified but no index file was exported.
Changes will only be visible after the next 'export'!
There have been errors!

This was being uploaded from Windows 11 and issues persists on both Firefox and Chrome.