#linuxcnc-devel Logs

Jun 30 2017

12:53 AM hazzy1 is now known as hazzy
07:39 AM jepler: cradek: did you get a chance to download & try the -r2 isos?
08:03 AM jepler: (the -r2 isos are all stretch packages, no jessie mixed in)
08:03 AM jepler: (but they use buildbot packages, not wlo packages)
08:28 AM cradek: no, sorry. this weekend I hope.
09:46 AM jepler: cradek: np. I really wanted a pretense to plug it again
10:32 AM skunkworks: cat
10:32 AM skunkworks: heh -
10:34 AM skunkworks: jepler, if I wanted to switch to get rid of the jessie mix on this install - what would be a way to do it?
10:36 AM jepler: skunkworks: I don't have a recipe for that
10:37 AM jepler: it would involve manually removing all the "leaf" jessie packages (linuxcnc-uspace at least, and anything else that is from linuxcnc.org like mesaflash, truetype-tracer, which may or may not have been on the last image) and then "apt autoremove" to remove automatically installed packages
10:37 AM jepler: there might be a relevant search you can do in synaptic
10:37 AM jepler: anyway then you'd disable the jessie repos in synaptic, enable buildbot stretch packages and wlo stretch base packages, and reinstall the software you want back
10:37 AM jepler: afk
10:37 AM skunkworks: Thanks!
11:25 AM skunkworks: what would be the stretch deb lines be then?
11:30 AM skunkworks: deb http://buildbot.linuxcnc.org/ stretch 2.7-rtpreempt
11:30 AM skunkworks: deb-src http://buildbot.linuxcnc.org/ stretch 2.7-rtpreempt
11:30 AM skunkworks: from the build bot page
11:30 AM skunkworks: for 2.7
11:31 AM seb_kuzminsky: yep that's is
11:31 AM seb_kuzminsky: *it
11:31 AM skunkworks: ooh - update worked.. Now to install :)
11:38 AM skunkworks: that seemed to work. Uninstalled linuxcnc - removed the deb lines for jessie and updated and stuff
11:39 AM jepler: wow the iso will boot to the desktop with as little as 256MB RAM configured in qemu
11:40 AM jepler: but it's verra slo
11:42 AM seb_kuzminsky: now try building linuxcnc on that vm
12:01 PM jepler: no thanks
12:03 PM jepler: 555M linuxcnc-stretch-uspace-i386-min-dfsg.iso
12:04 PM jepler: if someone wants one that fits on a CD we could do that
12:04 PM seb_kuzminsky: oh that reminds me... do your isos include the non-free firmwares that are so often needed to get wifi hardware to work?
12:05 PM jepler: they include firmware-linux which pulls in firmware-linux-free and firmare-linux-nonfree
12:05 PM jepler: so yes I think so
12:05 PM seb_kuzminsky: great
12:08 PM jepler: https://github.com/jepler/stretch-live-build/compare/needless-complication?expand=1
12:09 PM jepler: I think this is probably really a needless complication, hence the branch name
12:11 PM seb_kuzminsky: if it's not broken, it doesn't have enough features yet
12:11 PM jepler: that's an interesting perspective to share
12:16 PM seb_kuzminsky: hmm, zsync just failed to download the i386-r2 iso
12:16 PM jepler: oh?
12:16 PM seb_kuzminsky: looks like 403
12:16 PM seb_kuzminsky: yeah
12:17 PM seb_kuzminsky: the .zsync is ok, the .iso is forbidden
12:17 PM jepler: that's not good, why wouldi t be 403?
12:17 PM jepler: fixed
12:17 PM seb_kuzminsky: hmm, i'm in the http://www.linuxcnc.org/testing-stretch-amd64-rtpreempt/ directory
12:18 PM jepler: both the r2 iso files were 0600 permissions for some reason
12:18 PM seb_kuzminsky: in the non "-amd64" directory it downloads fine
12:18 PM jepler: those are symlinks to the same location
12:19 PM jepler: if it works now it's because I chmodded the files, I think
12:19 PM seb_kuzminsky: heh ok
12:19 PM seb_kuzminsky: thanks!
12:19 PM jepler: I wonder how the files got 0600 permissions, that's contrary to the umask of the user I ran zsync as
12:21 PM seb_kuzminsky: i booted the amd64-r2 iso in a vm here, and it failed in the "Load installer components from CD" stage
12:22 PM seb_kuzminsky: it
12:22 PM seb_kuzminsky: it's saying it can't copy files from the CD, and to check that the CD is in the drive
12:22 PM seb_kuzminsky: the iso is mounted in the expected place and seems fine from the shell
12:22 PM jepler: ugh
12:22 PM seb_kuzminsky: i wonder what file it's having trouble with
12:22 PM jepler: I did test the installer once, but not for -r2
12:23 PM cradek: check all your vts
12:23 PM seb_kuzminsky: wow, the busybox more is pretty lame
12:24 PM jepler: anyway yes zsync calls open(...|O_CREAT, 0600) and so regardless of your umask the zsync-downloaded file is not readable by group or other
12:25 PM cradek: they should feel bad
12:25 PM jepler: I agree, I have the same problem as seb
12:25 PM seb_kuzminsky: but it's moar secure
12:25 PM seb_kuzminsky: di says: "Base system not installeable from CD, requesting choose-mirror"
12:25 PM jepler: dangit this worked with -v0 and I didn't check it since then because why would you
12:26 PM seb_kuzminsky: and "error: Unable to find '/dev/shmpool/main/x/xfsprogs-udeb/xfsprogs-udeb_4.9.0+nmu1_amd64.deb'"
12:26 PM seb_kuzminsky: that's a funny path
12:27 PM seb_kuzminsky: part of trying to configure load-cdrom, apparently
12:27 PM cradek: ugh udebs
12:27 PM cradek: I never did understand that
12:27 PM seb_kuzminsky: sure, but yay <10G install isos
12:27 PM jepler: /dev/shm is a temporary path I use while generating the installer
12:28 PM seb_kuzminsky: the xfsprogs udeb is in pool/ on the iso
12:30 PM seb_kuzminsky: at least i have the -r2 now, to seed the download of -r3!
12:31 PM skunkworks: I had to get the firmware for the wireless nic in this laptop..
12:32 PM skunkworks: during the install - maybe it would have found it after the install? The livecd didn't boot with working wireless.
12:32 PM skunkworks: but I had that problem with jessie also
12:32 PM cradek: I just put all that nonfree garbage on the wheezy cd and ignored my feelings
12:32 PM seb_kuzminsky: the live environment should have access to all the firmware, and should have working wifi, i believe
12:33 PM jepler: skunkworks: hmph, I thought it was included :-/
12:33 PM seb_kuzminsky: cradek: i think that's the right answer
12:33 PM cradek: I think it is a beneficial thing to do
12:33 PM jepler: yeah that's what I expected too
12:33 PM skunkworks: Network controller: Intel Corporation Centrino Advanced-N 6205 [Taylor Peak] (rev 34)
12:34 PM seb_kuzminsky: huh, intel hardware usually works pretty painlessly on linux
12:34 PM cradek: Taylor Peak sounds like a pornstar
12:34 PM skunkworks: I don't remember what firmware it said I needed - but google found it
12:34 PM jepler: skunkworks: which one did you install, -v0 or -r1 ?
12:34 PM skunkworks: r1
12:35 PM jepler: I have a theory about the problem. Somewhere, probably after -r1 but before -r2, I set TMPDIR=/dev/shm
12:35 PM jepler: during the build process of the iso
12:36 PM jepler: clearly this has had some effect
12:38 PM jepler: skunkworks: so you didn't have wireless when booted "live"? what package did you add after installation to get the device supported?
12:41 PM jepler: yes, TMPDIR=/dev/shm [and TMPDIR=/dev/shm/] both create this problem
12:42 PM seb_kuzminsky: great!
12:42 PM skunkworks: During the installation it said I needed firmware for my wireless nic - insert media was said firmware. Let me see if I can find the actuall firmware it needed
12:42 PM jepler: skunkworks: the first question I'm asking is about when you booted "live" to the desktop
12:42 PM skunkworks: no - I didn't get working wireless during the live boot
12:42 PM jepler: skunkworks: we haven't even gotten to the second part of the question yet
12:42 PM jepler: booo
12:43 PM skunkworks: pretty sure it wanted iwlwifi-6000g2a-6.ucode and iwlwifi-6000g2a-5.ucode
12:44 PM skunkworks: Think I got it here https://packages.debian.org/stretch/firmware-iwlwifi
12:45 PM jepler: hm
12:45 PM jepler: I naively thought firmware-linux pulled general wireless firmwares in, but it appears I'm mistaken
12:46 PM skunkworks: This is a pretty old machine
12:51 PM jepler: lapt_udeb.py: packages = re.sub(r"/tmp.*pool", "pool", packages)
12:51 PM jepler: /^l//
12:51 PM jepler: well I found why it gets those pathnames. dang dawg
12:52 PM seb_kuzminsky: not every TMPDIR is /tmp, but it's an easy shortcut to take
12:52 PM * seb_kuzminsky glances guiltily at his own scripts
01:11 PM cradek: jepler: stuff like http://timeguy.com/gitweb?p=live-images.git;a=commitdiff;h=d6433b934 makes me think it might be smart for you to page through these commits from last time
01:12 PM cradek: might save you some questions/trouble
01:12 PM cradek: but you probably did this already...
01:13 PM jepler: no I didn't
01:13 PM jepler: I started with a blank screen
01:14 PM jepler: I can't preseed
01:14 PM jepler: fwiw
01:15 PM jepler: it's .. just not there in live-wrapper
01:16 PM cradek: I didn't mean anything about preseed exactly, but that you should check and see if when you create users they end up with dialout group (serial port permissions)
02:07 PM jepler: sigh argh
02:07 PM jepler: so part of the answer seems to be, they must be generating the official debian images with a version of live-wrapper that is different than the one "in debian"
02:07 PM jepler: wtf
02:07 PM jepler: .. which accepts a "-f" argument of firmrware packages to install
02:08 PM jepler: https://cdimage.debian.org/cdimage/unofficial/non-free/cd-including-firmware/9.0.1-live+nonfree/i386/iso-hybrid/debian-live-9.0.1-i386-xfce+nonfree.log shows use of the "-f" flag which doesn't exist in the one in stretch
02:10 PM jepler: $ lwr -f lol
02:10 PM jepler: Usage: lwr [options]
02:10 PM jepler: lwr: error: no such option: -f
02:19 PM jepler: not only that, they're changes that also aren't in the supposed official repository of live-wrapper
02:20 PM jepler: but they are in some guy's git, I think
02:20 PM cradek: aw jeez
03:17 PM jepler: File "/vms/lw/live-wrapper/lwr/apt_udeb.py", line 96, in download_package
03:17 PM jepler: raise cliapp.AppException('%s is not available' % name)
03:17 PM jepler: AppException: is not available
03:17 PM jepler: now what
03:49 PM skunkworks: jepler, ethernet works
03:52 PM jepler: skunkworks: it'll probably continue working long after all wireless has broken
03:52 PM jepler: I could be wrong, but I don't think so.
04:01 PM skunkworks: (I meant with linuxcnc and mesa boards... ;) )
04:01 PM jepler: skunkworks: ah I thought it was still on the subject of getting an internet connection for the installer
04:02 PM jepler: Read linuxcnc-stretch-uspace-amd64-r2.iso. Target 79.7% complete.
04:03 PM jepler: .. r3 in the process of uploading
04:04 PM seb_kuzminsky: grooby
04:04 PM jepler: it should include firmware, which is the reason for the image's growth
04:04 PM seb_kuzminsky: i think the smallest usb storage device i have (that still works) is either 4 or 8 gig, so anything below that doesn't matter to me
04:04 PM seb_kuzminsky: but having wifi work out of the box does
04:05 PM seb_kuzminsky: so thank you
04:05 PM jepler: we'll let skunkworks test whether the firmwares work
04:05 PM skunkworks: hmm - that would take a bit
04:06 PM jepler: don't sweat it
04:06 PM skunkworks: :)
04:07 PM seb_kuzminsky: when the upload is done, will you chmod it again?
04:07 PM jepler: yes I will
04:08 PM jepler: right now I'm wrestling with god knows what editor that bash ctrl-x ctrl-e dropped me into
04:08 PM jepler: it is autowrapping the long commandline I want to edit and it thinks that a - at the end of a line might represent hyphenation it should get rid of when it re-wraps the commandline
04:08 PM * jepler shivers
04:09 PM jepler: I didn't know there was an editor worse than pico/nano but I think I just used it
04:14 PM jepler: OK new files up, permissions should be OK for the isos and zsyncs
04:14 PM seb_kuzminsky: zsyncing now!
04:15 PM jepler: boy $DAY_JOB's internet is slow and/or saturated by my fellow users
04:16 PM seb_kuzminsky: ok r3 is fetching the components off the iso successfully
04:16 PM jepler: I tested that before uploading, believe it or not
04:16 PM jepler: .. this time
04:22 PM seb_kuzminsky: it's alive! nice work jepler
04:23 PM jepler: yw. afk
04:25 PM seb_kuzminsky: it immediately wants to upgrade some important packages, including the kernel and libc
04:25 PM seb_kuzminsky: does it build from a stale local cache of debs?
04:43 PM jepler: seb_kuzminsky: it .. shouldn't?
04:44 PM jepler: it *is* using a cache locally, but I thought it only cached the .debs, not the metadata
04:44 PM jepler: I wonder if the updates and/or security repositories are configured when it runs
04:46 PM jepler: http://paste.debian.net/974173/
04:46 PM jepler: yeah I think that's the thing
04:46 PM jepler: were they configured after you installed?
04:48 PM seb_kuzminsky: i installed, rebooted without the cdrom, apt-get update and apt-get dist-upgrade, and it downloaded and installed a bunch of packages
04:51 PM seb_kuzminsky: here's the dpkg.log: http://highlab.com/~seb/linuxcnc/dpkg.log
04:51 PM seb_kuzminsky: it starts with a timestamp of 20:19, which is the pre-ntp install-time
04:52 PM seb_kuzminsky: it configures the linux-image deb
04:52 PM seb_kuzminsky: debs
04:53 PM seb_kuzminsky: then later, after the install finishes and it reboots and has the correct time, at 14:55:24 it upgrades linux-image
04:53 PM seb_kuzminsky: that's me running apt-get update && dist-upgrade
04:53 PM seb_kuzminsky: looks like it goes from 4.9.30-2 to 4.9.30-2+deb9u2
04:54 PM seb_kuzminsky: -2 came from ftp.debian.org, -2+deb9u2 came from security.d.o
04:54 PM seb_kuzminsky: i'm nit picking now...
04:54 PM jepler: I don't mind
04:55 PM seb_kuzminsky: right after install, before running apt-get, it ran latency-histogram fine, and it looks like it's working
04:55 PM jepler: but yes it appears that security and updates repos are not available during the image build
04:55 PM seb_kuzminsky: linuxcnc runs
04:56 PM seb_kuzminsky: i'd call it a win
04:57 PM seb_kuzminsky: the disk usage is noticably higher than it was with the wheezy installer
04:57 PM seb_kuzminsky: i've gotten used to making 10gb disks for my linuxcnc VMs, but that's uncomfortably tight for this one
04:57 PM jepler: yeah?
04:58 PM seb_kuzminsky: 1 gig to swap, 9 gigs to /, install the build dependencies, and it's down to 1.5 GB free
04:58 PM seb_kuzminsky: i think i'll switch to 20 GB VM disks and not worry about it
05:00 PM jepler: we talked about the tradeoffs of installing a full desktop system vs something minimal
05:00 PM jepler: if you think it's due to a mistake other than "let's install a full xfce desktop" then I'm happy to talk about what that mistake is
05:02 PM seb_kuzminsky: instead of suggesting ways to make the installed size smaller, i'm going to suggest you make it bigger, by including openssh-server in the default load
05:02 PM jepler: hey I've got a better idea
05:02 PM jepler: we'll pre install the buildbot builder
05:03 PM seb_kuzminsky: heh
05:03 PM seb_kuzminsky: or distcc
05:03 PM seb_kuzminsky: people are always talking about wanting to donate to the project...
05:03 PM jepler: did we have openssh-server on the wheezy live image?
05:03 PM jepler: er install image, whatever tech it was
05:04 PM seb_kuzminsky: i'm pretty sure we did, not 100%
05:04 PM jepler: I could look at that repo cradek pointed me at earlier
05:04 PM seb_kuzminsky: i don't recall having to install it all the time
05:05 PM jepler: I worry a little bit about weak passwords and open by default ssh
05:05 PM seb_kuzminsky: hmm, yeah
05:05 PM jepler: the next big internet worm will spread on the l:p pair seb:seb or something
05:05 PM seb_kuzminsky: it's seb:password, but yeah
05:06 PM jepler: jepler: (╯°□°）╯︵ ┻━┻
05:06 PM jepler: Setting up linux-image-4.9.0-3-rt-686-pae (4.9.30-2+deb9u2) ...
05:15 PM seb_kuzminsky: http://paste.debian.net/974181/
05:15 PM seb_kuzminsky: the things that look like chaff to me probably look like wheat to other folks
05:15 PM seb_kuzminsky: gcc-avr?
05:15 PM jepler: that's a lot of stuff
05:15 PM seb_kuzminsky: gimp-data?
05:16 PM seb_kuzminsky: it's surprising how big git is
05:16 PM seb_kuzminsky: even bigger than linuxcnc-uspace
05:16 PM jepler: one of the firmwares seems to bring it in
05:16 PM jepler: expeyes-firmware-dev, probably shouldn't be installed
05:17 PM jepler: I copied the list of firmware from someone else and they must have copied it from grep or something
05:17 PM jepler: hey, I caught where it installed an arm toolchain for some other one!
05:17 PM seb_kuzminsky: it hurts a bit to have two 200 meg kernels installed, one -rt and one not
05:18 PM seb_kuzminsky: i shouldn't have truncated the package names...
05:19 PM seb_kuzminsky: http://paste.debian.net/974183/
05:21 PM jepler: linux-image-4.9.0-3-amd64 is installed?
05:21 PM seb_kuzminsky: do we need those big texlive-*-doc packages? I guess they were pulled in as recommends by the texlive debs linuxcnc build-depends on
05:23 PM jepler: you're the one who install linuxcnc build depends aren't you?
05:23 PM jepler: specify --no-install-recommends if you want --no-install-recommends
05:24 PM seb_kuzminsky: i did install everything dpkg-checkbuilddeps wanted, withou specifying --no-install-recommends
05:24 PM seb_kuzminsky: so that part's my fault, not your iso's
05:24 PM jepler: I recommend using: mk-build-deps -irs sudo
05:24 PM * seb_kuzminsky makes note
05:24 PM jepler: is it possible that linux-image-4.9.0-3-amd64 is "rc" i.e., removed but with conffiles remaining?
05:24 PM jepler: (by dpkg -l)
05:25 PM seb_kuzminsky: oh, yeah, you're right
05:25 PM seb_kuzminsky: Package: linux-image-4.9.0-3-amd64
05:25 PM seb_kuzminsky: Status: deinstall ok config-files
05:25 PM jepler: .. I'm changing it to 'apt remove --purge'
05:25 PM seb_kuzminsky: cool
05:26 PM seb_kuzminsky: can you add bash-completion.deb?
05:26 PM seb_kuzminsky: or maybe i should make a PR?
05:26 PM jepler: nah it's on my mental shortlist
05:48 PM jepler: should I toss in git?
05:57 PM jepler: seb_kuzminsky: when I installed openssh-server and booted the live CD twice, I got the same openssh host keys so that's obviously a terrible idea
06:16 PM jepler: that's much better, now there are at least two different sets of keys generated (the early-boot-entropy problem)
06:22 PM jepler: the iso boots with (non-secure) UEFI qemu-system-x86_64 --bios /usr/share/qemu/OVMF.fd
06:27 PM jepler: and once installed it also boots properly
07:20 PM jepler: -r4 up
07:21 PM jepler: around 40 megs smaller than the last one, after eliminating some unlikely firmwares (like the one that pulled in the compiler for AVRs)
07:21 PM seb_kuzminsky: rockin'
07:21 PM jepler: cf68127 only invoke debconf-set-selections once for all firmwares
07:21 PM jepler: d43ac64 purge traces of the non-rt kernel
07:21 PM jepler: 566874f Pick up updates during image build
07:21 PM jepler: other salient changes
07:22 PM jepler: though I still saw updates after a fresh install they were fewer. dunno why there were still any though.
07:22 PM jepler: (no kernel to update)
07:22 PM jepler: afk again
07:31 PM jepler: booted to the desktop -r4 sees the wifi (iwlwifi) on my laptop.
07:35 PM jepler: and when booted into the installer as well
08:51 PM jepler: also boots with non-secured uefi on my desktop