Failed to compile v2.9.0-pre0-7465-gc8dd11e89e deb packages

[ihabmmali]

Here are the steps I follow to reproduce the issue:

1. cd [Linuxcnc source directory]
2. git pull origin master
3. cd debian
4. ./configure no-docs uspace
5. cd ..
6. dpkg-buildpackage -b -uc

This is what I expected to happen:

successful compilation and generation of deb packages

This is what happened instead:

Several warning regarding missing files
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/halstreamer.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/halstreamer.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/hy_gt_vfd.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/hy_gt_vfd.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/linuxcnc.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/linuxcnc.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/pi500_vfd.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/pi500_vfd.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/sendkeys.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/sendkeys.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/svd-ps_vfd.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/svd-ps_vfd.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/thermistor.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/thermistor.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/wj200_vfd.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/wj200_vfd.1
dh_install: warning: Cannot find (any matches for) "usr/share/man/man1/xhc-whb04b-6.1" (tried in ., debian/tmp)

dh_install: warning: linuxcnc-uspace missing files: usr/share/man/man1/xhc-whb04b-6.1

Followed By:

dh_install: error: missing files, aborting
make: *** [debian/rules:38: binary] Error 255

It worked properly before this:

Recent code pull on 8/19/2022

After some trial and error it appears commit 36b83c6 is the cause of the issue. Resetting my local repo to the previous commit appears to resolve the issue.

Information about my hardware and software:

• I am using this Linux distribution and version (often, shown by lsb_release -a): Debian 11

• I am using this kernel version (shown by uname -a): 5.18.0-2-rt-amd64

• I am running ...

  • A binary version from linuxcnc.org (including buildbot.linuxcnc.org)
  • [X ] A binary I built myself
  • A binary version from some other source besides linuxcnc.org

• I am using this LinuxCNC version (shown in package manager or, for git versions, scripts/get-version-from-git):v2.9.0-pre0-7465-gc8dd11e89e

• I am using this user interface (GUI) (e.g., AXIS, Touchy, gmoccapy, etc):qtdragon

• I am using this interface hardware vendor and chipset (e.g., parallel port, ethernet port, FPGA card): Mesa cards

[petterreinholdtsen]

I suspect this issue is fixed by pull request #1942.

…

-- Happy hacking Petter Reinholdtsen

[SebKuzminsky]

I believe it was commits 4685506 and 1ab6d72 that introduced this build failure (but only on distros newer than the ones our CI tests, i.e. where dh_missing can fail the build instead of just warn).

But yes, #1942 should fix it.

[annhan]

• I pulled Fix deb build again #1942 but the error is stilling

[petterreinholdtsen]

[NhanPham]

- I pulled #1942 but the error is stilling

#1942 is in master now. Do you get the same build error if you use debuild from the devscripts package, without any command line options? This tool do more checking, and might give a better indication on what is wrong. My test build of master work, not sure what is special about your setup.

…

-- Happy hacking Petter Reinholdtsen

[annhan]

[NhanPham]

• I pulled Fix deb build again #1942 but the error is stilling
  Fix deb build again #1942 is in master now. Do you get the same build error if you use debuild from the devscripts package, without any command line options? This tool do more checking, and might give a better indication on what is wrong. My test build of master work, not sure what is special about your setup.
  …
  -- Happy hacking Petter Reinholdtsen

i built in master brand. Just type:

git pull
cd debian
./configure no-docs uspace
cd ..
dpkg-buildpackage -b -uc

and got same above error

[petterreinholdtsen]

[NhanPham]

i built in master brand now. Just type: ``` git pull cd debian ./configure no-docs uspace cd .. dpkg-buildpackage -b -uc ```

I tested a few variations, and you can drop 'uspace' from the list above. The 'no-docs' option break the build. No idea why, but it is probably a bug in the recent build system adjustments. If you want to build before it is fixed, I recommend 'debian/configure && debuild' to get installable .deb files.

…

-- Happy hacking Petter Reinholdtsen

[ihabmmali]

The latest build system from the current pull also introduces these dependencies: asciidoc source-highlight asciidoc-dblatex

These appear to be documentation build related but the system now seems to ignore the "no-docs" option @SebKuzminsky

@petterreinholdtsen same results with debuild if no-docs selected obviously but no additional information provided beyond the same warning about missing man files as indicated in the issue

[petterreinholdtsen]

[Eyecon]

These appear to be documentation build related but the system now seems to ignore the "no-docs" option @SebKuzminsky

It is not ignored, but the no-docs build need some of the tools earlier only used by the docs build. Missing build dependencies would be detected by debuild, which is one of the reasons I am more interested in test builds using that tool than ones using dpkg-buildpackage. -- Happy hacking Petter Reinholdtsen

[annhan]

[NhanPham]
i built in master brand now. Just type: git pull cd debian ./configure no-docs uspace cd .. dpkg-buildpackage -b -uc
I tested a few variations, and you can drop 'uspace' from the list above. The 'no-docs' option break the build. No idea why, but it is probably a bug in the recent build system adjustments. If you want to build before it is fixed, I recommend 'debian/configure && debuild' to get installable .deb files.
…
-- Happy hacking Petter Reinholdtsen

i typed debian/configure && debuild and still get the error:

dh_install: Cannot find (any matches for) "usr/lib/python3" (tried in ., debian/tmp)

dh_install: linuxcnc-uspace missing files: usr/lib/python3
	install -d debian/.debhelper/generated/linuxcnc-uspace-dev
	install -d debian/linuxcnc-uspace/
	cp --reflink=auto -a debian/tmp/etc debian/linuxcnc-uspace//
	install -d debian/linuxcnc-uspace//usr/bin
	cp --reflink=auto -a debian/tmp/usr/bin/5axisgui debian/tmp/usr/bin/axis debian/tmp/usr/bin/axis-remote debian/tmp/usr/bin/classicladder debian/tmp/usr/bin/debuglevel debian/tmp/usr/bin/elbpcom debian/tmp/usr/bin/genserkins debian/tmp/usr/bin/gladevcp debian/tmp/usr/bin/gladevcp_demo debian/tmp/usr/bin/gmoccapy debian/tmp/usr/bin/gremlin_view debian/tmp/usr/bin/gs2_vfd debian/tmp/usr/bin/gscreen debian/tmp/usr/bin/hal-histogram debian/tmp/usr/bin/hal_input debian/tmp/usr/bin/hal_manualtoolchange debian/tmp/usr/bin/halcmd debian/tmp/usr/bin/halcmd_twopass debian/tmp/usr/bin/halmeter debian/tmp/usr/bin/halreport debian/tmp/usr/bin/halrmt debian/tmp/usr/bin/halrun debian/tmp/usr/bin/halsampler debian/tmp/usr/bin/halscope debian/tmp/usr/bin/halshow debian/tmp/usr/bin/halstreamer debian/tmp/usr/bin/haltcl debian/tmp/usr/bin/halui debian/tmp/usr/bin/hbmgui debian/tmp/usr/bin/hexagui debian/tmp/usr/bin/hy_gt_vfd debian/tmp/usr/bin/hy_vfd debian/tmp/usr/bin/image-to-gcode debian/tmp/usr/bin/inivar debian/tmp/usr/bin/io debian/tmp/usr/bin/iov2 debian/tmp/usr/bin/latency-histogram debian/tmp/usr/bin/latency-plot debian/tmp/usr/bin/latency-test debian/tmp/usr/bin/lineardelta debian/tmp/usr/bin/linuxcnc debian/tmp/usr/bin/linuxcnc_info debian/tmp/usr/bin/linuxcnc_module_helper debian/tmp/usr/bin/linuxcnc_var debian/tmp/usr/bin/linuxcnclcd debian/tmp/usr/bin/linuxcncmkdesktop debian/tmp/usr/bin/linuxcncrsh debian/tmp/usr/bin/linuxcncsvr debian/tmp/usr/bin/linuxcnctop debian/tmp/usr/bin/maho600gui debian/tmp/usr/bin/max5gui debian/tmp/usr/bin/mb2hal debian/tmp/usr/bin/mdi debian/tmp/usr/bin/melfagui debian/tmp/usr/bin/milltask debian/tmp/usr/bin/millturngui debian/tmp/usr/bin/mitsub_vfd debian/tmp/usr/bin/monitor-xhc-hb04 debian/tmp/usr/bin/motion-logger debian/tmp/usr/bin/moveoff_gui debian/tmp/usr/bin/ngcgui debian/tmp/usr/bin/panelui debian/tmp/usr/bin/pi500_vfd debian/tmp/usr/bin/pmx485 debian/tmp/usr/bin/pmx485-test debian/tmp/usr/bin/pncconf debian/tmp/usr/bin/puma560gui debian/tmp/usr/bin/pumagui debian/tmp/usr/bin/pyngcgui debian/tmp/usr/bin/pyui debian/tmp/usr/bin/pyvcp debian/tmp/usr/bin/pyvcp_demo debian/tmp/usr/bin/qtplasmac-cfg2prefs debian/tmp/usr/bin/qtplasmac-materials debian/tmp/usr/bin/qtplasmac-plasmac2qt debian/tmp/usr/bin/qtplasmac_gcode debian/tmp/usr/bin/qtvcp debian/tmp/usr/bin/rotarydelta debian/tmp/usr/bin/rs274 debian/tmp/usr/bin/rtapi_app debian/tmp/usr/bin/scaragui debian/tmp/usr/bin/schedrmt debian/tmp/usr/bin/scorbot-er-3 debian/tmp/usr/bin/sendkeys debian/tmp/usr/bin/shuttle debian/tmp/usr/bin/sim-torch debian/tmp/usr/bin/sim_pin debian/tmp/usr/bin/simulate_probe debian/tmp/usr/bin/stepconf debian/tmp/usr/bin/svd-ps_vfd debian/tmp/usr/bin/teach-in debian/tmp/usr/bin/thermistor debian/tmp/usr/bin/tool_mmap_read debian/tmp/usr/bin/tool_watch debian/tmp/usr/bin/tooledit debian/tmp/usr/bin/touchy debian/tmp/usr/bin/update_ini debian/tmp/usr/bin/vfdb_vfd debian/tmp/usr/bin/vfs11_vfd debian/tmp/usr/bin/wj200_vfd debian/tmp/usr/bin/xhc-hb04 debian/tmp/usr/bin/xhc-hb04-accels debian/tmp/usr/bin/xhc-whb04b-6 debian/tmp/usr/bin/xyzac-trt-gui debian/tmp/usr/bin/xyzbc-trt-gui debian/linuxcnc-uspace//usr/bin/
	install -d debian/linuxcnc-uspace//usr/lib
	cp --reflink=auto -a debian/tmp/usr/lib/libcanterp.so.0 debian/tmp/usr/lib/liblinuxcnchal.so.0 debian/tmp/usr/lib/liblinuxcncini.so.0 debian/tmp/usr/lib/libnml.so.0 debian/tmp/usr/lib/libposemath.so.0 debian/tmp/usr/lib/libpyplugin.so.0 debian/tmp/usr/lib/librs274.so.0 debian/tmp/usr/lib/libtooldata.so.0 debian/tmp/usr/lib/linuxcnc debian/linuxcnc-uspace//usr/lib/
dh_install: missing files, aborting
	install -d debian/.debhelper/generated/linuxcnc-uspace
	install -d debian/.debhelper/generated/linuxcnc-doc-en
	install -d debian/.debhelper/generated/linuxcnc-doc-fr
	install -d debian/.debhelper/generated/linuxcnc-doc-es
	install -d debian/.debhelper/generated/linuxcnc-doc-zh-cn
make: *** [debian/rules:38: binary] Error 25
dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2
debuild: fatal error at line 1182:
dpkg-buildpackage -us -uc -ui failed

[ihabmmali]

It is not ignored, but the no-docs build need some of the tools earlier only used by the docs build.

What I dont understand is why the no-docs build didn't need these packages before but now it does. I had to install 877MB of additional tools and language files not relevant to the main build just to get the build to work

Missing build dependencies would be detected by debuild, which is one of the reasons I am more interested in test builds using that tool than ones using dpkg-buildpackage.

I didn't see any difference in behavior between debuild and dpkg-buildpackage but I don't know much about the debian packaging system. To me both debuild and dpkg-build report missing dependencies and won't let the build proceed before the dependencies are satisfied

[petterreinholdtsen]

[Eyecon]

What I dont understand is why the no-docs build didn't need these packages before but now it does. I had to install 877MB of additional tools and language files not relevant to the main build just to get the build to work

This happened in ca8510d and it contain this explanation: The manpages go in linuxcnc-uspace.deb (not in linuxcnc-doc-en), so they are built with the architecture-dependent ("binary") debs. Since some manpages are written in asciidoc rather than roff, these build dependencies are needed in Build-Depends (which is satisfied for both architecture-dependent and architecture-independent builds), not just in Build-Depends-Indep. The no-docs option disable building the HTML and PDF editions that would get separate linuxcnc-doc packages, but man pages are still created.

…

-- Happy hacking Petter Reinholdtsen

[ihabmmali]

[Eyecon]
What I dont understand is why the no-docs build didn't need these packages before but now it does. I had to install 877MB of additional tools and language files not relevant to the main build just to get the build to work
This happened in ca8510d and it contain this explanation: The manpages go in linuxcnc-uspace.deb (not in linuxcnc-doc-en), so they are built with the architecture-dependent ("binary") debs. Since some manpages are written in asciidoc rather than roff, these build dependencies are needed in Build-Depends (which is satisfied for both architecture-dependent and architecture-independent builds), not just in Build-Depends-Indep. The no-docs option disable building the HTML and PDF editions that would get separate linuxcnc-doc packages, but man pages are still created.
…
-- Happy hacking Petter Reinholdtsen

Thanks Petter, that makes sense. So any idea what we can do to generate the missing man pages causing dh_install to fail?

[cnc-NexT]

Hello [petterreinholdtsen], [annhan]
since I have the same problem not beeing able to build the *.deb's .... is there any progress with that matter ? or any idea when it can be expected ?
What is a solution to work around that problem ?

[petterreinholdtsen]

[udoS]

Hello [petterreinholdtsen], [annhan] since I have the same problem not beeing able to build the *.deb's .... is there any progress with that matter ? or any idea when it can be expected ?

No idea.

What is a solution to work around that problem ?

The obvious workaround is to drop the no-docs debian/configure option.

…

-- Happy hacking Petter Reinholdtsen