Ok i have a 5TB usb hard drive that is mostly used for weekly backups of my system. It is hooked to a raspberry pi and has an exfat file system and used as a samba share.
But i need to occasionally unplug it and connect it directly to some other machines for 2 reasons.
-
For use with steam on linux (i store my games on it)
-
For use with obs on windows (i do some screen recording and need to be able to save the output to the drive)
Here’s the dilemma. Games that require proton will not launch from an exfat drive (trust me i’ve tried all the “hacks” and cant make it happen). So i plan to reformat the drive as an ext4 file system.
However, windows does not support ext4 natively. I do have WSL and could probably mount it there but here are the issues.
Another user in my house will be primarily the one using obs and they are not technically inclined (or at least not linux inclined) i want them to be able to plug this device in and just press record and have it output to the drive, this was working fine with exfat but obviously once i reformat it could be an issue.
I have a few options and wanted to run it by here first before committing to the reformat.
Option 1) reformat drive to ext4. Keep it as a samba drive at all times, except when gaming, and have obs output the video to the drive over the network
-is obs capable of doing this reliably?
Option 2) reformat to ext4 and unplug drive when gaming or needing to use obs. Rig up a script to automount the drive with wsl when detected.
-will the mounted drive show up in the windows file explorer natively? Or could i at least pin its location to quick access?
-can i actually create some way for it to automount the drive with no user input required?
-ooh but the distro is on the drive to conserve the laptop's space, could present an issue
Option 3) reformat the drive as part ntfs part ext4 and then plug it in for gaming and obs?
-i believe in linux i could just add the part-uuid to fstab so it only mounts the ext4 portion or maybe i could mount both?
-would windows automatically just mount the ntfs portion?
Imo, option 1 is the best but i would like to have a fail safe in case i ever need to plug it directly to the windows machine. So realistically a hybrid of option 1 and 2 is best. Is there a better way to do this? Will any of these methods work?
Just use NTFS for the whole drive. The new
NTFS3
kernel driver in Linux has fairly decent performance (waay better than the oldntfs-3g
driver), and has been pretty stable since kernel 6.2.The key thing you’d want to do though is to use the mount options
nocase
andwindows_names
in your fstab.-
nocase
enables case-insensitive file/folder support similar to the default behavior under Windows with NTFS volumes. -
windows_names
prevents the creation of files or directories with names not allowed under Windows. This checks for forbidden characters in the name like /, , :, *, ?, <, >, |, " or ending with a space or a period. There are also other checks for matching the behavior of Windows with this mount option for rejecting file/folder names that may be valid on Linux systems but not under Windows.
These two mount options should solve most of the issues Linux NTFS users may face. Do note that to use the above mount options, you’ll need to be on at least kernel 6.2.
I got 2 questions. How do permissions work with ntfs on linux. I use rsync a lot to backup to the drive and i’ve read how exfat doesnt really save all the linux permissions. Likewise from my research in order to run a proton game on a ntfs drive would require symlinking rhe compat directory to my home folder. And i use the home folder for smaller games. I have heard that it may or may not work with ntfs
-
Damn, I just formatted a new SSD with exfat for a shared Steam library across Windows and Linux PCs. I haven’t noticed any issues yet, but thanks for the topic. I might just end up switching to BTRFS.
deleted by creator
deleted by creator
NTFS will give you issues just like exfat. You can partition it as multiple partitions. 1 ntfs, 1 ext4. Or I personally for Linux have been using btrfs.
There is a btrfs driver for windows, but I don’t know much about ita use cases.
the UDF filesystem is supported by both windows and linux, and will have acceptable performance on both unlike the windows BTRFS driver. Unlike exfat, it supports all the funky stuff needed to make steam games work.
I’m not really worried about performance on windows since i will only very occasionally be plugging it in there. Ive never heard of udf but will check it out too
Well Windows just doesnt really support any performant Linux partition formats, afaik
Except for UDF, as I pointed out in my comment. UDF is easily forgotten because it is kinda weird, but it fits the bill here and has native drivers in Windows, Linux, and MacOS.
I just use BTRFS. There’s an open source driver for Windows you can install.
I’m leaning toward btrfs. Gonna set it up tonight and test. Is there any major differences from ext4 i should know? I know it has snapshots but i read about if you dont use the right kind of drives it can corrupt data, is thus true or not really something i should worry about?
It has a lot of differences to ext4 but it’s still just a file system. You’re not gonna notice any difference just normally using the drive (aside from copying being instant). I’ve never heard about it causing corruptions on different kinds of drives. I use it on 3 SSDs and one HDD and have no issues.
Ok i’m running into some issues. I have formatted with btrfs but immediately it does not work when attempting to mount.
I had it mounted and then set up with fstab, test installing some games to it but the second i ejected the device and then reattached it it cannot be mounted.
I get the error
An error occurred while accessing 'wd_black5tb', the system responded: The requested operation has failed: Error mounting system-managed device /dev/sdb1: wrong fs type, bad option, bad superblock on /dev/sdb1, missing codepage or helper program, or other error
I also installed winbtrfs with chocolatey but the drive fails to show up once plugged in and i dont see the drive anywhere
It looks like it either didn’t get ejected properly and something is corrupt or you’re mounting it wrong. It’s probably the first tho. BTRFS has very good commandline tools that can help you fix this.
Yeah it seems like it was a permissions error. I set the tight permissions and now i have it working
- For use with steam on linux (i store my games on it)
Have you actually played a game from a mechanical HDD yet? I’m asking because 99% of “freezing” troubleshooting/help posts in gaming subs that I follow on that other site that shall not be named are because the OP stores their games on a mechanical HDD instead of a SSD, so if you’ve been doing this, I’m curious how your experience has been so far.
If you have a little extra cash to burn, I’d recommend springing for an extra 256 GB SSD or something, which can be had for $30 on Amazon in the US (not sure about your country).
EDIT:
- For use with obs on windows (i do some screen recording and need to be able to save the output to the drive)
Now that I think about it, I’d be shocked if recording video to a mechanical HDD went smoothly as well. If my prediction is correct, then you might consider first recording the session to the OS drive (assuming it’s a SSD), and then copying the file to the HDD for long term storage after you finish recording.
So i mostly play older games (half life, skyrim, dishonored, etc) i have no issues with the mechanical drive for these. Now admittedly the larger games like skyrim i havent tried on linux only on windows but i dont see why it would be an issue.
I will probably eventually get a ssd for gaming and make the hdd purely for storage.
I have already recorded to this drive from the windows device with no issues. It is not intended to be super high quality tho. I just dont know if running over the network will go as smooth.
Rn, im leaning towards using btrfs bc it seems the performance speed between it and ext4 will be negligible and i will be testing out the driver for windows and obs over the network.
Mount it on a spare PC and share it on the network with samba.
Did you read it at all?
Yes and the answer is you can’t do it in anyway that’s fool proof that won’t eventually result in data loss. Just buy another one and be done with it.
I probably will eventually. I put btrfs on it and it works pretty well. Im a little iffy on the windows driver but i tested obs and it can write over the network just fine.