HFS+ and exFAT support for usb SSDs on Leap 42.1

Hi,
I wonder how to setup HFS+ and exFAT support for usb3 mount, format and r/w access to SSD disks on Leap 42.1 ?
(I have a external video recorder that require these file systems on the SSDs)

HFS+
So far I have just installed diskdev_cmds for hfsplus tools from here
https://software.opensuse.org/ymp/home:malcolmlewis:openSUSE_General/openSUSE_Leap_42.1/diskdev_cmds.ymp?base=openSUSE%3ALeap%3A42.1&query=diskdev_cmds

In lack of such support in YaST2 partitioner, I was able to format the SSD with HFS+ by installing and using Gparted, which also loaded some packages for hfsplus.

I can also get the SSD usb3 dock mounted as “untitled” with Gnome files, but it looks to be unstable. As soon as I try to access (copy) a larger video file from SSD to an internal ext4 disk, the usb mounted “untitled” SSD disappear and just a part of the file is copied.

So I wonder how to possibly setup diskdev_cmds to get this stable for practical use?

exFAT
So far I have just tried to install two packages, exfat-utils and fuse-exfat
But the exFAT formatted SSD (from Win10) won’t mount from the usb3 dock.

Any suggestions how to install and set up exFAT support to work on 42.1 ?

Cheers,
Terje H.

Hi
Remove my diskdev_cmds package and install hfsutils package which should provide the tools needed.

Try manually mounting your exfat device as root user (shouldn’t need the -t exfat option);


mount /dev/sdX /mnt

Does that work?

Hi and thanks for the suggestions.
But sorry - no success so far …

HFS+

# df -h
Filesystem      Size  Used Avail Use% Mounted on
.....
/dev/sdb1       459G  199G  237G  46% /video
....
/dev/sdd2       477G  2.1G  475G   1% /run/media/terje/untitled
/dev/sdc1       1.8T  362G  1.4T  21% /run/media/terje/Seagate_2TB_back

linux-sb1z:~ # file /run/media/terje/untitled/*
/run/media/terje/untitled/$RECYCLE.BIN:    directory
/run/media/terje/untitled/Capture0000.mov: Apple QuickTime movie (unoptimized)

linux-sb1z:~ # ls -ld /run/media/terje/untitled
drwxr-xr-x 1 root root 5 Feb 20 00:50 /run/media/terje/untitled
linux-sb1z:~ # ls -la /run/media/terje/untitled/*
-rw-r--r-- 1   99   99 1786412681 Feb 24 00:49 /run/media/terje/untitled/Capture0000.mov

linux-sb1z:~ # cp /run/media/terje/untitled/Capture0000.mov /video
cp: error reading ‘/run/media/terje/untitled/Capture0000.mov’: Input/output error
cp: failed to extend ‘/video/Capture0000.mov’: Input/output error

and /dev/sdd2 was immediately disconnected, also if I just click Properties on the .mov file in Gnome files
(I also think ‘copy and paste’ within Gnome files yesterday reported something like cannot do splice …?)
(Tried also ‘hcopy’ first instead of cp, but the system reported the file was not hmounted)

exFAT

# mount /dev/sdd2 /mnt
mount: unknown filesystem type 'exfat'

linux-sb1z:~ # mount -t exfat /dev/sdd2 /mnt
mount: unknown filesystem type 'exfat'

And this message did popup by click on Video1-SSD in Gnome Files:
Cannot access «Video1-SSD»

Error mounting /dev/sdd2 at /run/media/terje/Video1-SSD: Command-line `mount -t "exfat" -o "uhelper=udisks2,nodev,nosuid,uid=1000,gid=100,iocharset=utf8,namecase=0,errors=remount-ro,umask=0077" "/dev/sdd2" "/run/media/terje/Video1-SSD"' exited with non-zero exit status 32: mount: unknown filesystem type 'exfat'

On Wed 24 Feb 2016 06:26:01 PM CST, terjejh wrote:

Hi and thanks for the suggestions.
But sorry - no success so far …

Hi
OK, for the exfat file try;


mount.exfat /dev/sdXn /mnt
/dev/sdb1 on /mnt type fuseblk (rw,nosuid,nodev,relatime,user_id=0,group_id=0,default_permissions,allow_other,blksize=4096)

I have no issues with hfplus I just click on the partition in Nautilus,
it asks for the password and it mounts…


/dev/sda2 on /run/media/malcolml/disk0s2 type hfsplus (ro,nosuid,nodev,relatime,umask=22,uid=0,gid=0,nls=utf8,uhelper=udisks2)

This is a MacBook3,1 running osX 10.7.5 and Leap dual boot. If I
connect an external usb disk formated at hfsplus, it just automounts…


/dev/sdb2 on /run/media/malcolml/ type hfsplus (ro,nosuid,nodev,relatime,umask=22,uid=0,gid=0,nls=utf8,uhelper=udisks2)


Cheers Malcolm °¿° LFCS, SUSE Knowledge Partner (Linux Counter #276890)
SUSE Linux Enterprise Desktop 12 SP1|GNOME 3.10.4|3.12.51-60.25-default
If you find this post helpful and are logged into the web interface,
please show your appreciation and click on the star below… Thanks!

It happends I get one single file copied from the SSD disk before /dev/sdc2 is automatic mounted off. After that it can be difficult (slow) to get it automounted again, even after reboot. Can the cp errors below have to do with the relative large video files I try to copy?


/dev/sdc2 on /run/media/terje/untitled type hfsplus (ro,nosuid,nodev,relatime,umask=22,uid=0,gid=0,nls=utf8,uhelper=udisks2)

# df -h
Filesystem      Size  Used Avail Use% Mounted on
---------
/dev/sda2       424G   87G  315G  22% /data
/dev/sdc2       477G  7.8G  470G   2% /run/media/terje/untitled

linux-sb1z:~ # file /run/media/terje/untitled/*
/run/media/terje/untitled/$RECYCLE.BIN:    directory
/run/media/terje/untitled/Capture0000.mov: Apple QuickTime movie (unoptimized)
/run/media/terje/untitled/Capture0001.mov: Apple QuickTime movie (unoptimized)
/run/media/terje/untitled/Capture0002.mov: Apple QuickTime movie (unoptimized)
/run/media/terje/untitled/Capture0003.mov: Apple QuickTime movie (unoptimized)
/run/media/terje/untitled/Capture0004.mov: Apple QuickTime movie (unoptimized)
/run/media/terje/untitled/Capture0005.mov: Apple QuickTime movie (unoptimized)
/run/media/terje/untitled/Capture0006.mov: Apple QuickTime movie (unoptimized)

linux-sb1z:~ # du -sh /run/media/terje/untitled/*
4.0K    /run/media/terje/untitled/$RECYCLE.BIN
1.7G    /run/media/terje/untitled/Capture0000.mov
508M    /run/media/terje/untitled/Capture0001.mov
284M    /run/media/terje/untitled/Capture0002.mov
561M    /run/media/terje/untitled/Capture0003.mov
1.3G    /run/media/terje/untitled/Capture0004.mov
1.5G    /run/media/terje/untitled/Capture0005.mov
1.7G    /run/media/terje/untitled/Capture0006.mov

linux-sb1z:~ # cp /run/media/terje/untitled/Capture0002.mov /data
linux-sb1z:~ # 
linux-sb1z:~ # cp /run/media/terje/untitled/Capture0003.mov /video
cp: error reading ‘/run/media/terje/untitled/Capture0003.mov’: Input/output error
cp: failed to extend ‘/video/Capture0003.mov’: Input/output error

linux-sb1z:~ # df -h 
Filesystem      Size  Used Avail Use% Mounted on
---------
/dev/sda2       424G   88G  315G  22% /data

Thanks,
Terje J. H

A comment to my last po

linux-sb1z:~ # cp /run/media/terje/untitled/Capture0003.mov /video cp: error reading ‘/run/media/terje/untitled/Capture0003.mov’: Input/output error
cp: failed to extend ‘/video/Capture0003.mov’: Input/output error

Only a part of ‘/video/Capture0003.mov’ has been copied when ‘/run/media/terje/untitled’ on the usb3 mounted SSD is unmounted

linux-sb1z:~ # du -sh /video/Capture0003.mov
1.5M	/video/Capture0003.mov

Is there a better, more failsafe method to copy (transfer) large files between different file systems (hsf+ to ext4)?


Terje J. H

On Fri 26 Feb 2016 12:36:01 PM CST, terjejh wrote:

A comment to my last po

Code:

linux-sb1z:~ # cp /run/media/terje/untitled/Capture0003.mov /video
cp: error reading ‘/run/media/terje/untitled/Capture0003.mov’:
Input/output error cp: failed to extend ‘/video/Capture0003.mov’:
Input/output error --------------------

Only a part of ‘/video/Capture0003.mov’ has been copied when
‘/run/media/terje/untitled’ on the usb3 mounted SSD is unmounted

Code:

linux-sb1z:~ # du -sh /video/Capture0003.mov
1.5M /video/Capture0003.mov


Is there a better, more failsafe method to copy (transfer) large files
between different file systems (hsf+ to ext4)?


Terje J. H

Hi
I wonder if it’s the USB side of things, I’ve had no issues
transferring iso images, but on my system they are a drive partition,
or via a drive attached to an apple airport device (smb).

Can you try a USB 2.0 port?


Cheers Malcolm °¿° LFCS, SUSE Knowledge Partner (Linux Counter #276890)
SUSE Linux Enterprise Desktop 12 SP1|GNOME 3.10.4|3.12.53-60.30-default
If you find this post helpful and are logged into the web interface,
please show your appreciation and click on the star below… Thanks!

Yeah, I tried an usb2 port instead, and was able to copy three files each 1.5G without problems.
The 512MB SATA SSD is mounted in an externatl Akasa duo docking station with usb3/usb2-compatible connection. http://www.akasa.com.tw/search.php?seed=AK-DK02U3
(usb3 will be required for high speed transfer of large video files recorded on a Blackmagic design HyperDeck Shuttle 2 SSD 10-bit video recorder:)

On the other hand I have used a usb3 2TB disk for rsync backup of the Leap machine disks and this has worked flawlessly. I also tried to disconnect this disk while using the usb3 docking, but the same disconnect issue occured.

It seems like the may be a bug combining usb3 and hfs+ ?

On Sun 28 Feb 2016 05:16:02 PM CST, terjejh wrote:

Yeah, I tried an usb2 port instead, and was able to copy three files
each 1.5G without problems.
The 512MB SATA SSD is mounted in an externatl Akasa duo docking station
with usb3/usb2-compatible connection.
DuoDock 2S | | Akasa Thermal Solution
(usb3 will be required for high speed transfer of large video files
recorded on a Blackmagic design HyperDeck Shuttle 2 SSD 10-bit video
recorder:)

On the other hand I have used a usb3 2TB disk for rsync backup of the
Leap machine disks and this has worked flawlessly. I also tried to
disconnect this disk while using the usb3 docking, but the same
disconnect issue occured.

It seems like the may be a bug combining usb3 and hfs+ ?

Hi
Yes, I would guess a bug report is probably in order, may needs a quirk
added…
http://en.opensuse.org/openSUSE:Submitting_bug_reports

If you do raise one, post the bug link back here for completeness :wink:


Cheers Malcolm °¿° LFCS, SUSE Knowledge Partner (Linux Counter #276890)
SUSE Linux Enterprise Desktop 12 SP1|GNOME 3.10.4|3.12.53-60.30-default
If you find this post helpful and are logged into the web interface,
please show your appreciation and click on the star below… Thanks!

Hm.
The video recorded files on the hfs+ SSD are read-only, and I didn’t find a way to remove stored files on it. Googling around it looks like the Journaling has to be disabled from a Mac OSX to get read/write file access from Linux …?

So I decided to (clear out) and reformat the SSD with Gparted to free up the space again.
Then I discovered that ‘hfs+’ and ‘exfat’ options were greyed out on the Gparted file system menu.
I verified in the Gparted table that ‘hfsprogs’ was a dependice for these file systems, but that package is not available for openSUSE.

However, after reinstalling the ‘diskdev_cmds’ package these menu items again became enable and I could format it again.
So it looks like diskdev_cmds is necessary despite the hfsutils package…?

(I have not forgot the usb3 bug report, but I would test some real large video files 40-100G first)

On Mon 14 Mar 2016 12:06:01 PM CDT, terjejh wrote:

malcolmlewis;2755773 Wrote:
> Hi
> Remove my diskdev_cmds package and install hfsutils package which
> should provide the tools needed.
> …

Hm.
The video recorded files on the hfs+ SSD are read-only, and I didn’t
find a way to remove stored files on it. Googling around it looks like
the Journaling has to be disabled from a Mac OSX to get read/write file
access from Linux …?

So I decided to (clear out) and reformat the SSD with Gparted to free up
the space again.
Then I discovered that ‘hfs+’ and ‘exfat’ options were greyed out on the
Gparted file system menu.
I verified in the Gparted table that ‘hfsprogs’ was a dependice for
these file systems, but that package is not available for openSUSE.

However, after reinstalling the ‘diskdev_cmds’ package these menu items
again became enable and I could format it again.
So it looks like diskdev_cmds is necessary despite the hfsutils
package…?

Hi
Just checked here and yes it mounts read-only, however I can copy files
fine from the partition? It may also just be ownership since on osX it
shows my user as 501/cdrom…

If you check /etc/filesystems for a hfsplus entry that’s probably why
it’s greyed out, my diskdev_cmds package does check and add (and also
remove on uninstall).


Cheers Malcolm °¿° LFCS, SUSE Knowledge Partner (Linux Counter #276890)
SUSE Linux Enterprise Desktop 12 SP1|GNOME 3.10.4|3.12.53-60.30-default
If you find this post helpful and are logged into the web interface,
please show your appreciation and click on the star below… Thanks!

Yeah, with diskdev_cmds installed, I can create and remove hfs+ files with root access in a terminal. The missing link is that a normal Gnome user has only read access in Nautilus where hfs+ is auto-mounted. In my case the owner and group are denoted ‘99’ as follows:

# ls -la /run/media/terje/untitled
total 78227516
drwxr-xr-x  1 root root           6 Mar 14 17:10 .
drwxr-x---+ 4 root root          80 Mar 14 16:54 ..
-rw-r--r--  1   99   99 42620607033 Mar  4 11:39 Capture0000.mov
-rw-r--r--  1   99   99 37484367393 Mar  4 16:34 Capture0001.mov
-rw-r--r--  1 root root           0 Mar 14 17:10 test

And exfat and hfsplus are listed in /etc/filesystems

~> ls -la  /etc/filesystems
-rw-r--r-- 1 root root 51 mars  13 15:23 /etc/filesystems
terje@linux-sb1z:~> cat /etc/filesystems
vfat
hfs
minix
reiserfs
exfat
exfat_fuse
hfsplus
*

Hi
If you remove diskdev_cmds it will be gone, so just add it manually… seems to also be a bug in the hfs tools perhaps…

I can keep diskdev_cmds installed, if there is no drawback.
As root I changed the group to users and added write access as well. Then unmounted the hfs+ disk with Nautilus, power off and on the usb SSD dock so the hfs+ was automounted. I was still now able to remove a test file as user.

~> ls -la /run/media/terje/untitled
totalt 78227516
drwxr-xr-x  1 root root           5 mars  14 20:13 .
drwxr-x---+ 4 root root          80 mars  14 16:54 ..
-rw-r--r--  1   99   99 42620607033 mars   4 11:39 Capture0000.mov
-rw-r--r--  1   99   99 37484367393 mars   4 16:34 Capture0001.mov

linux-sb1z:~ # chgrp -R users /run/media/terje/untitled
linux-sb1z:~ # ls -la /run/media/terje/untitled
total 78227516
drwxr-xr-x  1 root users           5 Mar 14 20:13 .
drwxr-x---+ 4 root root           80 Mar 14 16:54 ..
-rw-r--r--  1   99 users 42620607033 Mar  4 11:39 Capture0000.mov
-rw-r--r--  1   99 users 37484367393 Mar  4 16:34 Capture0001.mov

linux-sb1z:~ # chmod -R 775 /run/media/terje/untitled
linux-sb1z:~ # ls -la /run/media/terje/untitled
total 78227516
drwxrwxr-x  1 root users           5 Mar 14 20:13 .
drwxr-x---+ 4 root root           80 Mar 14 16:54 ..
-rwxrwxr-x  1   99 users 42620607033 Mar  4 11:39 Capture0000.mov
-rwxrwxr-x  1   99 users 37484367393 Mar  4 16:34 Capture0001.mov

linux-sb1z:~ # logout
terje@linux-sb1z:~> cd /run/media/terje/untitled
terje@linux-sb1z:/run/media/terje/untitled> touch test2
terje@linux-sb1z:/run/media/terje/untitled> ls 
Capture0000.mov  Capture0001.mov  test2

terje@linux-sb1z:/run/media/terje/untitled> ls -la .
totalt 78227516
drwxrwxr-x  1 root  users           6 mars  14 21:12 .
drwxr-x---+ 4 root  root           80 mars  14 16:54 ..
-rwxrwxr-x  1    99 users 42620607033 mars   4 11:39 Capture0000.mov
-rwxrwxr-x  1    99 users 37484367393 mars   4 16:34 Capture0001.mov
-rw-r--r--  1 terje users           0 mars  14 21:12 test2

terje@linux-sb1z:/run/media/terje/untitled> cd
terje@linux-sb1z:~> ls -la /run/media/terje/untitled
totalt 78227516
drwxrwxr-x  1 root  users           6 mars  14 21:12 .
drwxr-x---+ 4 root  root           80 mars  14 21:14 ..
-rwxrwxr-x  1    99 users 42620607033 mars   4 11:39 Capture0000.mov
-rwxrwxr-x  1    99 users 37484367393 mars   4 16:34 Capture0001.mov
-rw-r--r--  1 terje users           0 mars  14 21:12 test2

terje@linux-sb1z:~> rm /run/media/terje/untitled/test2

Hi
So all is good in hfsplus land then…? I use a airport extreme for ethernet and also a USB disk attached for timemachine backups as well as smb access from either osX or openSUSE/SLE, then I also run netatalk on my server for the osX machine or via afp:// in nautilus. So many ways… :wink: