Ok i have a 5TB usb hard drive that is mostly used for weekly backups of my system. It is hooked to a raspberry pi and has an exfat file system and used as a samba share.

But i need to occasionally unplug it and connect it directly to some other machines for 2 reasons.

  1. For use with steam on linux (i store my games on it)

  2. For use with obs on windows (i do some screen recording and need to be able to save the output to the drive)

Here’s the dilemma. Games that require proton will not launch from an exfat drive (trust me i’ve tried all the “hacks” and cant make it happen). So i plan to reformat the drive as an ext4 file system.

However, windows does not support ext4 natively. I do have WSL and could probably mount it there but here are the issues.

Another user in my house will be primarily the one using obs and they are not technically inclined (or at least not linux inclined) i want them to be able to plug this device in and just press record and have it output to the drive, this was working fine with exfat but obviously once i reformat it could be an issue.

I have a few options and wanted to run it by here first before committing to the reformat.

Option 1) reformat drive to ext4. Keep it as a samba drive at all times, except when gaming, and have obs output the video to the drive over the network

-is obs capable of doing this reliably?

Option 2) reformat to ext4 and unplug drive when gaming or needing to use obs. Rig up a script to automount the drive with wsl when detected.

-will the mounted drive show up in the windows file explorer natively? Or could i at least pin its location to quick access?
-can i actually create some way for it to automount the drive with no user input required?
-ooh but the distro is on the drive to conserve the laptop's space, could present an issue

Option 3) reformat the drive as part ntfs part ext4 and then plug it in for gaming and obs?

-i believe in linux i could just add the part-uuid to fstab so it only mounts the ext4 portion or maybe i could mount both?
-would windows automatically just mount the ntfs portion?

Imo, option 1 is the best but i would like to have a fail safe in case i ever need to plug it directly to the windows machine. So realistically a hybrid of option 1 and 2 is best. Is there a better way to do this? Will any of these methods work?

  • d3Xt3r@lemmy.nzM
    link
    fedilink
    arrow-up
    5
    ·
    1 year ago

    Just use NTFS for the whole drive. The new NTFS3 kernel driver in Linux has fairly decent performance (waay better than the old ntfs-3g driver), and has been pretty stable since kernel 6.2.

    The key thing you’d want to do though is to use the mount options nocase and windows_names in your fstab.

    • nocase enables case-insensitive file/folder support similar to the default behavior under Windows with NTFS volumes.

    • windows_names prevents the creation of files or directories with names not allowed under Windows. This checks for forbidden characters in the name like /, , :, *, ?, <, >, |, " or ending with a space or a period. There are also other checks for matching the behavior of Windows with this mount option for rejecting file/folder names that may be valid on Linux systems but not under Windows.

    These two mount options should solve most of the issues Linux NTFS users may face. Do note that to use the above mount options, you’ll need to be on at least kernel 6.2.

    • neosheo@discuss.tchncs.deOP
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      I got 2 questions. How do permissions work with ntfs on linux. I use rsync a lot to backup to the drive and i’ve read how exfat doesnt really save all the linux permissions. Likewise from my research in order to run a proton game on a ntfs drive would require symlinking rhe compat directory to my home folder. And i use the home folder for smaller games. I have heard that it may or may not work with ntfs

  • flubba86@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    edit-2
    1 year ago

    Damn, I just formatted a new SSD with exfat for a shared Steam library across Windows and Linux PCs. I haven’t noticed any issues yet, but thanks for the topic. I might just end up switching to BTRFS.

  • Hellmo_luciferrari@lemm.ee
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    1 year ago

    NTFS will give you issues just like exfat. You can partition it as multiple partitions. 1 ntfs, 1 ext4. Or I personally for Linux have been using btrfs.

    There is a btrfs driver for windows, but I don’t know much about ita use cases.

  • ferret@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    the UDF filesystem is supported by both windows and linux, and will have acceptable performance on both unlike the windows BTRFS driver. Unlike exfat, it supports all the funky stuff needed to make steam games work.

    • neosheo@discuss.tchncs.deOP
      link
      fedilink
      arrow-up
      0
      ·
      1 year ago

      I’m not really worried about performance on windows since i will only very occasionally be plugging it in there. Ive never heard of udf but will check it out too

        • ferret@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 year ago

          Except for UDF, as I pointed out in my comment. UDF is easily forgotten because it is kinda weird, but it fits the bill here and has native drivers in Windows, Linux, and MacOS.

  • Fisch@lemmy.ml
    link
    fedilink
    arrow-up
    1
    ·
    1 year ago

    I just use BTRFS. There’s an open source driver for Windows you can install.

    • neosheo@discuss.tchncs.deOP
      link
      fedilink
      arrow-up
      0
      ·
      1 year ago

      I’m leaning toward btrfs. Gonna set it up tonight and test. Is there any major differences from ext4 i should know? I know it has snapshots but i read about if you dont use the right kind of drives it can corrupt data, is thus true or not really something i should worry about?

      • Fisch@lemmy.ml
        link
        fedilink
        arrow-up
        0
        ·
        1 year ago

        It has a lot of differences to ext4 but it’s still just a file system. You’re not gonna notice any difference just normally using the drive (aside from copying being instant). I’ve never heard about it causing corruptions on different kinds of drives. I use it on 3 SSDs and one HDD and have no issues.

        • neosheo@discuss.tchncs.deOP
          link
          fedilink
          arrow-up
          0
          ·
          1 year ago

          Ok i’m running into some issues. I have formatted with btrfs but immediately it does not work when attempting to mount.

          I had it mounted and then set up with fstab, test installing some games to it but the second i ejected the device and then reattached it it cannot be mounted.

          I get the error

          An error occurred while accessing 'wd_black5tb', the system responded: The requested operation has failed: Error mounting system-managed device /dev/sdb1: wrong fs type, bad option, bad superblock on /dev/sdb1, missing codepage or helper program, or other error
          

          I also installed winbtrfs with chocolatey but the drive fails to show up once plugged in and i dont see the drive anywhere

          • Fisch@lemmy.ml
            link
            fedilink
            arrow-up
            1
            ·
            1 year ago

            It looks like it either didn’t get ejected properly and something is corrupt or you’re mounting it wrong. It’s probably the first tho. BTRFS has very good commandline tools that can help you fix this.

  • yo_scottie_oh@lemmy.ml
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    1 year ago
    1. For use with steam on linux (i store my games on it)

    Have you actually played a game from a mechanical HDD yet? I’m asking because 99% of “freezing” troubleshooting/help posts in gaming subs that I follow on that other site that shall not be named are because the OP stores their games on a mechanical HDD instead of a SSD, so if you’ve been doing this, I’m curious how your experience has been so far.

    If you have a little extra cash to burn, I’d recommend springing for an extra 256 GB SSD or something, which can be had for $30 on Amazon in the US (not sure about your country).

    EDIT:

    1. For use with obs on windows (i do some screen recording and need to be able to save the output to the drive)

    Now that I think about it, I’d be shocked if recording video to a mechanical HDD went smoothly as well. If my prediction is correct, then you might consider first recording the session to the OS drive (assuming it’s a SSD), and then copying the file to the HDD for long term storage after you finish recording.

    • neosheo@discuss.tchncs.deOP
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      So i mostly play older games (half life, skyrim, dishonored, etc) i have no issues with the mechanical drive for these. Now admittedly the larger games like skyrim i havent tried on linux only on windows but i dont see why it would be an issue.

      I will probably eventually get a ssd for gaming and make the hdd purely for storage.

      I have already recorded to this drive from the windows device with no issues. It is not intended to be super high quality tho. I just dont know if running over the network will go as smooth.

      Rn, im leaning towards using btrfs bc it seems the performance speed between it and ext4 will be negligible and i will be testing out the driver for windows and obs over the network.

      • fluffyb@lemmy.fluffyb.net
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        Yes and the answer is you can’t do it in anyway that’s fool proof that won’t eventually result in data loss. Just buy another one and be done with it.

        • neosheo@discuss.tchncs.deOP
          link
          fedilink
          arrow-up
          1
          ·
          1 year ago

          I probably will eventually. I put btrfs on it and it works pretty well. Im a little iffy on the windows driver but i tested obs and it can write over the network just fine.