| Age | Commit message (Collapse) | Author |
|---|
|
* Attempting a retry-attempt on the broken part of lsblk
* Improved logging
* Adding a retry to Partition._call_lsblk()
* Added error checks if lsblk returns nothing, also handles empty Partition().info instance.
* Added missing check of disk encryption is None or not.
* Added tweak to catching output from lsblk.stderr
* Added missing check of disk encryption is None or not.
* Fixed a logic test for empty lsblk info
* Fixed instances of None being interated
* Added some errro handling for weird block devices
* Fixed flake8
* Added /etc/vconsole.conf generation in Installer.mkinitcpio() as it's a dependency for it to generate properly without errors. Otherwise we'll get ==> ERRROR: file not found: '/etc/vconsole.conf'
* Prep for tagging RC1 of 2.5.3
* Corrected helpers.py get_blockdevice_info() to deal with empty lsblk results
|
|
* New encryption menu
Co-authored-by: Daniel Girtler <girtler.daniel@gmail.com>
Co-authored-by: Anton Hvornum <anton@hvornum.se>
|
|
* Updating Partition() information after mount and unmount.
* Cleaned up raw_parted() to gracefully output relevant partition error information.
* Adding timestmap to cmd_history.txt as it's impossible to debug properly otherwise
* Adding more verbose debugging information
* Reinstating the lsblk retry code for PARTUUID and UUID on Partition()'s information
* Added error handling for JSON parsing
|
|
* Moving a partprobe() call to better allow for cache updates
* Trying to improve Partition()._fetch_information()
* Removed a sleep() for debugging purposes
* Tweaked a sleep
|
|
* Solves issue 1343. Could not locate partition after creation
* Added some flake fixes.
Co-authored-by: Anton Hvornum <anton@hvornum.se>
|
|
* Cleanup partition
* Update
* Remove unused method
* Update partitioning
* Update
* Update
* Fix mypy
Co-authored-by: Daniel Girtler <girtler.daniel@gmail.com>
|
|
* Rework partition management
* Update
* Update list manager
* Update
* Update
Co-authored-by: Daniel Girtler <girtler.daniel@gmail.com>
|
|
* Update blockdevice class
Co-authored-by: Daniel Girtler <girtler.daniel@gmail.com>
|
|
* Update subvolume
* Add mypy compliance
Co-authored-by: Daniel Girtler <girtler.daniel@gmail.com>
Co-authored-by: Anton Hvornum <anton@hvornum.se>
|
|
|
|
* Adding debug information
* Adding debug information
* Adding debug information
* Removed a 'already-a-subvolume' check as it requires more information.
* Adding debug information
* Adding debug information
* Made sure Partition().subvolumes() only attempts to retrieve btrfs subvolume information if fstype==btrfs.
* Removed debug information
|
|
Fixed issue where `options` wasn't passed as `options=options` and got mixed up as fs-type.
|
|
# Fixes
* Optimized partition lookups
* Fixed re-use of partition UUID's
* `BlockDevice().get_partition()` now supports looking up both `PARTUUID` and `UUID` for a partition under itself
* Partitions listed in `--disk-layout` that doesn't have a PARTUUID/UUID should no longer cause an exception, but instead logs a warning and they will simply be ignored
* `Filesystem().add_partition()` now handles `DiskError` raised by `partition.part_uuid`
* Fixed issue on normal partitions where the device was not properly frozen in `lambda` calls, meaning two or more mount-points shared the same `device_instance`.
* Lowered global `DISK_RETRY_ATTEMPTS` to 5, as the timeouts are linear *(`range(DISK_RETRY_ATTEMPTS) * DISK_TIMEOUTS`)*
|
|
* Restructuring btrfs.py into lib/btrfs/*.py
* Reworking how BTRFS subvolumes get represented, and worked with. Subvolumes are now their own entity which can be used to access it's information, parents or mount location.
* Added BtrfsSubvolume.partition and other stuff.
* Reworking the way luks2().unlock and .format() returns device instances. They should now return BTRFSSubvolume where appropriate.
* Fixed a missing import
* Fixed an issue where mkfs.btrfs wouldn't trigger due to busy disk.
* Fixing subvol mounting without creating a fake instance.
* Added creation of mountpint for btrfs subvolume
* Fixed root detection
* Re-worked mounting into a queue system using frozen mounting calls using lambda
* Removed old mount_subvolume() function
* Removed get_subvolumes_from_findmnt()
* Fixed Partition().subvolumes iteration
* Adding .root to BtrfsSubvolume
* Fixed issue in SysCommandWorker where log output would break and crash execution due to cmd being a string vs list
* Changed return-value from MapperDev.mountpoint to pathlib.Path
|
|
* Added a HSM menu entry, but also a safety check to make sure a FIDO device is connected
* flake8 complaints
* Adding FIDO lookup using cryptenroll listing
* Added systemd-cryptenroll --fido2-device=list
* Removed old _select_hsm call
* Fixed flake8 complaints
* Added support for locking and unlocking with a HSM
* Removed hardcoded paths in favor of PR merge
* Removed hardcoded paths in favor of PR merge
* Fixed mypy complaint
* Flake8 issue
* Added sd-encrypt for HSM and revert back to encrypt when HSM is not used (stability reason)
* Added /etc/vconsole.conf and tweaked fido2_enroll() to use the proper paths
* Spelling error
* Using UUID instead of PARTUUID when using HSM. I can't figure out how to get sd-encrypt to use PARTUUID instead. Added a Partition().part_uuid function. Actually renamed .uuid to .part_uuid and created a .uuid instead.
* Adding missing package libfido2 and removed tpm2-device=auto as it overrides everything and forces password prompt to be used over FIDO2, no matter the order of the options.
* Added some notes to clarify some choices.
* Had to move libfido2 package install to later in the chain, as there's not even a base during mounting :P
|
|
* Optimized a bunch of partprobe calls. Namely fixed sleep calls, added optional path to the general archinstall.partprobe() call. And fixed some error handling in a few places which should tell us where #1083 might be going wrong.
* Fixed some flake8 complaints
* Fixed sleep having a min() of 0.1 or given value.
* Fixed sleep having a correct range variable.
* Fixed sleep logic to use max() instead of min() as it will never use the higer sleep values otheride
* Added error handling to Partition().partprobe() as it would cause certain issues with USB disks. Also made Partition()._safe_uuid more safe by eliminating exceptions being raised.
|
|
* Optimized a bunch of partprobe calls. Namely fixed sleep calls, added optional path to the general archinstall.partprobe() call. And fixed some error handling in a few places which should tell us where #1083 might be going wrong.
* Fixed some flake8 complaints
* Fixed sleep having a min() of 0.1 or given value.
* Fixed sleep having a correct range variable.
* Fixed sleep logic to use max() instead of min() as it will never use the higer sleep values otheride
|
|
|
|
disk handling. (#949)
* Renamed all_disks() to all_blockdevices() as it's technically a bit more correct. As it would return partitions as well. And it now distinguishes between BlockDevice() and Partition() when returning values. Also lsblk has been replaced with blkid and glob.glob() on /sys/class/block/
* Added handling of loop devices
* Added device information enrichment
* Removed old code
* Updated the usage of blockdevice.info['type'] to 'DEVTYPE' as per returned by blkid instead of lsblk
* Created a MapperDev() and DMCryptDev() 'disk' classes. This should help differentiate between BlockDevice(), Partition() and crypt-specific devices. Due to some new helper functions (mentioned later) BlockDevice().device_or_backfile has been simplified thanks to the information being pre-existing instead of having to call losetup. BlockDevice().mountpoint has been added as a dummy function. archinstall.enrich_blockdevice_information() has been added to enrich information extracted from blkid. archinstall.uevent() has been created to parse blkdid data when in -o export format, also eats up /sys/class/x/y/uevent data which is of the same format. all_blockdevices() now returns mapper devices found under /dev/mapper/ and properly returns the different types, not just BlockDevice() for everything. archinstall.get_parent_of_partition() has been added, which can translate /dev/sda1 to /dev/sda via strings by using /sys/class/block/ - note here tho that it has to be a blockdevice. Other parents won't return properly. archinstall.find_mountpoint() was created to be able to find mountpoints for a device, rather than the other way around which get_mount_info() handles. find_mountpoint() will convert /dev/sda1 -> /boot for instance, whereas get_mount_info('/boot') will convert /boot -> /dev/sda1. archinstall.get_partitions_in_use() will now properly traverse the entire structure, not just one level deep. This called for the creation of get_all_targets() which will take a dictionary structure and look for 'target': '/path' and return all '/path' values, recursively without being trapped in get_partitions_in_use() which has recursive targets. get_partitions_in_use() now returns a dictionary instead of a list, as it also returns the mountpoint and associated device. It will also prioritize MapperDev over DMCryptDev (as MapperDev is a child of DMCryptDev and can be resolved, other way around is 'trickier').
* Reverted Installer().partitions to return only the partitions. It's a slight speed defecit by not returning the mountpoints directly as {mntpoint: partition}, because the partition.mountpoint is a bit slow. But it avoids breaking legacy code :)
* Fixed a few imports, and added MapperDev.filesystem
* Fixed so that Installer().detect_encryption() uses the new separated logic of MapperDev/DMCryptDev/Partition
* Fixing a translation issue on hostname
* Added DMCryptDev.filesystem
* Added back archinstall.all_disks() for legacy reasons.
* Added a deprecation warning to archinstall.all_disks()
* Added a enrichment check for dm-crypt specific devices, which in turn sets DMCRYPT_NAME on the device information, making it easier to detect and target DMCryptDev when needed. This should avoid issues with loopdevices being detected as DMCryptDev. Also some minor tweaks to variable names on unencrypted setups
* Made debug output hidden without --verbose. Also added get_subvolume_info() which takes a path and returns any 'btrfs subvol show' information on the path
* Partition().subvolumes has been added. Which generates an iterator over potential subvolumes based on mountpoint. Partition().mount_information is now a list of mount-destinations, as one partition should be allowed to be mounted to several places (more commonly used in btrfs subvolumes). BtrfsSubvolume() has been added as a 'device type', which should make it more easy to recognize a BtrfsSubvolume object right out of the gate. Only found from Partition().subvolumes currently.
* Parameter fix for --verbose in log()
* Made sure loopdev devices have a PATH key as well, to make dealing with them as blockdevice as seamless as possible.
* Added backup information grabbing on uninitated devices
* Tweaked backup option if losetup cannot find the blockdev
* looks like losetup doesn't exit with a bad code even when it should. Raising ourselves when information is empty.
* Fixed structure returned from get_blockdevice_uevent()
* Made sure that fallback to blkid and loopdev info returns a PTTYPE (Partition Table Type) that is None, since we can't locate it yet (empty drive). But it's not False either, which is what logic after is looking for
* Deprecated split_bind_name() and added more debugging
* get_partitions_in_use() now only iterates over Partition() objects. And properly checks all mountpoints, not only the first.
* Flipped SysCallError to show the last 500 bytes if data rather than the first, to catch the actual errors.
* Removed anonymous parameters to all_blockdevices()
* Added .mount_information to MapperDev
* Added typing annotations
* Partition().mountpoint is now a @property that will live-report the current mountpoint.
* Removed the need for setting Partition().mountpoint = X when calling .mount() and .unmount(), as it's live-reported instead.
* Added .subvolumes to MapperDev()
* Added debug information
* Muting F841 in helpers.py
* Tweaked debug information in get_mount_info()
* Minimized log output by moving Partition().mountpoint to DEBUG, as partitions are allowed to not be mounted
* Simplified Installer().add_bootloader() to act as a router to the new split function, one for each bootloader type. This since flake8 complained about complexity and I agree that it became to wild.
|
|
partition end (#895)
* disk layout: allow to omit partition "start" option to start from previous partition end
* mixed tabs/spaces fixes
* Update filesystem.py
Co-authored-by: Anton Hvornum <anton.feeds+github@gmail.com>
|
|
* Added a new return value from add_partition. Also added an exception to make sure `add_partition` can't continue silently
* Added a log of debugging to add_partition
* Removed a blank line (flake8)
* Misconfigured variable
* Added some more debugging information to partprobe
* FIX: disk layout: partprobe should be called and checked only for target device (#896)
* disk layout: partprobe should be called and checked only for target device
* disk layout: partprobe: removed unnecessary bash subprocess
* Properly defined BlockDevice() on Partition() creation. Also made sure mount-checks got some rrro handling and non-block devices should no longer attempt to return a size
Co-authored-by: Anton Hvornum <anton.feeds@gmail.com>
Co-authored-by: Victor Gavro <vgavro@gmail.com>
|
|
device (#896)
* disk layout: partprobe should be called and checked only for target device
* disk layout: partprobe: removed unnecessary bash subprocess
|
|
.format() is called
|
|
When using archinstall on an existing Arch Linux installation, (e.g. for
migrating the current system on a new drive), no exception is raised if
mkfs.vfat is missing in the base install (no dosfstools package currently
installed).
|
|
* Added type annotations for 1/5 of the files.
There's bound to be some issues with type miss-match, will sort that out later.
* Added type hints for 4/5 of the code
* Added type hints for 4.7/5 of the code
* Added type hints for 5/5 of the code base
* Split the linters into individual files
This should help with more clearly show which runner is breaking since they don't share a single common name any longer. Also moved mypy settings into pyproject.toml
* Fixed some of the last flake8 issues
* Missing parameter
* Fixed invalid lookahead types
* __future__ had to be at the top
* Fixed last flake8 issues
|
|
* All the changes needed to make btrfs subvolumes work. It boils down to two points;
the handling of the addressing of subvolumes re. physical partitions, and the small changes at the bootloader level
* We added a new script only_hd for testing purposes. It only handles hadrd drive management
* restoring an escape hatch during subvolume processing
* hipercommented manage_btrfs_subvolumes
* Ready to be able to select and process options in subvolume mounting
* Separte nodatacow processing
* Solving a flake8 complain
* Use of bind names @ get_filesystem_type
* compress mount option bypass
* Preparations for encryption handling
* Compatibility to master version re. encrypted btrfs volumes
* Now we can create subvolumes and mountpoints inside an encrypted btrfs partition
* changes for entries file generation with systemd-bootctl
* flake8 corrections plus some comments
Co-authored-by: Anton Hvornum <anton@hvornum.se>
|
|
* Swapped lsblk for blkid
* Added a hefty sleep on partprobe()
And added a TODO for the future
|
|
* Update partition.py
* Added sleep after partprobe
Added sleep after partprobe. Without this tools such as lsblk may be unable to retrieve certain properties of devices (such as partuuid).
|
|
* Added support for storing disk encryption keyfiles and add them to a keyslot.
* Added a luks2().add_key() function in order to inject a keyfile into a keyslot on a encrypted volume.
* Simplified 'missing encryption password' logic in Filesystem(). Added a call to luks2().add_key() after the root-password is set on the volume, to add the keyfile in slot 2
* Adding in password handling in luks2().add_key(). It's required to enter a previous passphrase to unlock the volume and add a new keyslot. Also simplified the handling of partition in Installer().mount_ordered_layout()
* Adding in encryption on all partitions except /boot when encryption is opted in
* Removed setting size on Partition() as it's a read only value. No idea how Partition().size = size hasn't caused an issue before. Removed size=X argument to Partition()
* Added a uniqueness to the loopdevice name. This should ensure that multiple encrypted volumes can be opened at the same time, except for Partition().detect_inner_filesystem() operations which can only happen one at a time since they share namespace. This should never be an issue since archinstall is single threaded and no concurrent operations can/should happen.
* Added partprobe() as part of disk/helpers.py, added a /dev/ -> UUID mapper function called convert_device_to_uuid(path). Added a luks2().crypttab() function that sets up a /etc/crypttab entry.
* Moved the responsability for telling archinstall to generate a keyfile from Filesystem() to user_interaction.py. This should in the future be a user-input based value, and not something the Filesystem() automatically dictates.
* Added a retry mechanism to luks2().encrypt() to avoid having to re-start the installation when a device simply wasn't up yet.
* Swapping UUID= lookup from loopdev to physdev.
|
|
* Moved convert_size_to_gb() into disk/helpers.py, Added a Partition().size property meta function. Using the .size value to check if /boot is too small which will raise an exception. The only drawback is that it's done post-formatting. This in order to catch scenarios where formatting isn't used.
* Changed /boot warning from 0.15GB to 0.25GB
* Changed the wording in the warning when /boot is too small.
|
|
* For fun, allow NTFS as a root filesystem type
Add ability to format a filesystem as NTFS
Try to force filesystem type
Fix FAT mounting
* Split out mount fs type method
* Handle rootfstype on non-GRUB bootloaders
* Add -Q to mkfs.ntfs command line for quick formatting
* I believe this will fix GRUB with NTFS root
* Remove the fsck hook if NTFS is used as the root partition
* Looks like the string is ntfs3 not ntfs so this logic wasn't running
|
|
|
|
|
|
|
|
thing but handles the DisKerror. This way we can use it in more places.
|
|
|
|
doesn't immediately return None
|
|
should still be quick. (#730)
Co-authored-by: Anton Hvornum <anton.feeds@gmail.com>
|
|
* Added multiple `partprobe` calls and added a `.partprobe()` function on partitions, filesystem and blockdevice.
* Adding retry attempts to all UUID related operations tied to the boot process
* Tweaked logging for mounting and disk related operations
* Removed potential SysCall exception disruptor causing exceptions to go by unnoticed
* Increased the start position from 1MiB to 5MiB of /boot partition
* Optimized the GRUB installation & config code
* Improved Partition().uuid to never return None. Instead it will raise an exception if it can't get a PARTUUID within X retries with Y delay per attempt.
* Increased sleep timer for partition uuid retrieval, because even with a 3 second sleep it wasn't long enough even on fast devices.
* Make GRUB install to /dev/sda instead of /dev/sda1.
* Added 10 retries for retreiving PARTUUID with a one second sleep. Instead of increasing the sleep simply add more retries until we find a good balance on slower disks.
|
|
|
|
|
|
|
|
|
|
mostly how we called things in guided.py but also some SysCommand calls
|
|
This should enable people to use custom option arguments in their config files when scripting installations or using the API.
|
|
through a few of the menu's
|
|
through a few of the menu's
|
|
broken links as we expose all the functions through __init__.py - but you never know so I'll keep an eye for issues with this.
|