• decaptcha [none/use name]@hexbear.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    17 hours ago

    For software… TrueNAS is probably worth checking out but may require some tinkering. I’ve been running it since it was called FreeNAS, about 10 years now actually. It’s been rock solid but I decided to splash out on enterprise grade hardware at that time. Like, actually tracked down and bought the exact RAM modules from the mobo QVL type shit. I guess it was worth, bc I have had almost 0 issues with it once I got it set up the way I liked. I scarcely even log into the admin console anymore, it can be very hands off, set-and-forget, or what have you. I’m only asking it to be a NAS though. I used to fuck with the jail feature so I could have it also run services (bittorrent client, DVR, Plex, etc) but that was a huge pain in the ass for me so I ditched that idea and run services on a different machine now which I very much prefer. The newer TrueNAS versions may make this easier, I dunno.

    If I were starting from scratch today, I’d do it on surplus enterprise hardware (from ebay or a local computer thrift shop) and see if I could make copyparty work for me. Looks like a real nice app that could maybe do everything I need out of a fileserver, but I have no time to fuck with it and my needs are already met.

    • bigpharmasutra [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 hours ago

      This sounds incredibly complicated. Basically I just want to setup a storage setup with redundancy and a silent machine. I’ve got a Synology already but with the hard drives in it its way too annoying to keep in the same room so i hardly use it.

      • BountifulEggnog [she/her]@hexbear.net
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 hours ago

        I don’t own one, but look into n100/n150 machines. I had been looking at These but decided to upgrade an old pc instead. But the cpu is only a few watts so should be nice and quiet. Forget which exact reviews I’ve seen of it

    • invalidusernamelol [he/him]@hexbear.net
      link
      fedilink
      English
      arrow-up
      2
      ·
      14 hours ago

      Copyparty is cool, but it’s still a very green app. If you want to use that, I’d run it as a container within your TrueNAS/FreeNAS install. That way you get the foundation of the tested software with a fun UI added on top.

      Also having read some of the copy party source, it was written by a madman

      • decaptcha [none/use name]@hexbear.net
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        12 hours ago

        Yeah for sure if I get time to tinker I’ll just run copyparty separately, and that’s probably good advice for everyone, thanks. Wdym a madman? Did they leave a manifesto in the comments?

        • invalidusernamelol [he/him]@hexbear.net
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 hours ago

          There’s goofy design patterns and fun comments all over lol, the whole project is super cool, but absolutely someone’s passion project.

          I say this as someone who deeply respects what they have been able to accomplish. Namely making a Python application that can run on most versions of Python 2.7+ and Python 3.x.

          If you look at a lot of the backend stuff, they use a huge number of single and double character variables that live for the duration of an object and primarily use classes as namespaces. I’m just more used to seeing Python code that builds out clear abstractions and interfaces with the existing data model or implements interaction with that data model so you can use each component separately. Here’s an example of an __init__ for one of their monolithic classes (it’s ~5k lines in total)

          spoiler
          class SvcHub(object):
              """
              Hosts all services which cannot be parallelized due to reliance on monolithic resources.
              Creates a Broker which does most of the heavy stuff; hosted services can use this to perform work:
                  hub.broker.<say|ask>(destination, args_list).
          
              Either BrokerThr (plain threads) or BrokerMP (multiprocessing) is used depending on configuration.
              Nothing is returned synchronously; if you want any value returned from the call,
              put() can return a queue (if want_reply=True) which has a blocking get() with the response.
              """
          
              def __init__(
                  self,
                  args: argparse.Namespace,
                  dargs: argparse.Namespace,
                  argv: list[str],
                  printed: str,
              ) -> None:
                  self.args = args
                  self.dargs = dargs
                  self.argv = argv
                  self.E: EnvParams = args.E
                  self.no_ansi = args.no_ansi
                  self.tz = UTC if args.log_utc else None
                  self.logf: Optional[typing.TextIO] = None
                  self.logf_base_fn = ""
                  self.is_dut = False  # running in unittest; always False
                  self.stop_req = False
                  self.stopping = False
                  self.stopped = False
                  self.reload_req = False
                  self.reload_mutex = threading.Lock()
                  self.stop_cond = threading.Condition()
                  self.nsigs = 3
                  self.retcode = 0
                  self.httpsrv_up = 0
                  self.qr_tsz = None
          
                  self.log_mutex = threading.Lock()
                  self.cday = 0
                  self.cmon = 0
                  self.tstack = 0.0
          
                  self.iphash = HMaccas(os.path.join(self.E.cfg, "iphash"), 8)
          
                  if args.sss or args.s >= 3:
                      args.ss = True
                      args.no_dav = True
                      args.no_logues = True
                      args.no_readme = True
                      args.lo = args.lo or "cpp-%Y-%m%d-%H%M%S.txt.xz"
                      args.ls = args.ls or "**,*,ln,p,r"
          
                  if args.ss or args.s >= 2:
                      args.s = True
                      args.unpost = 0
                      args.no_del = True
                      args.no_mv = True
                      args.reflink = True
                      args.dav_auth = True
                      args.vague_403 = True
                      args.nih = True
          
                  if args.s:
                      args.dotpart = True
                      args.no_thumb = True
                      args.no_mtag_ff = True
                      args.no_robots = True
                      args.force_js = True
          
                  if not self._process_config():
                      raise Exception(BAD_CFG)
          
                  # for non-http clients (ftp, tftp)
                  self.bans: dict[str, int] = {}
                  self.gpwd = Garda(self.args.ban_pw)
                  self.gpwc = Garda(self.args.ban_pwc)
                  self.g404 = Garda(self.args.ban_404)
                  self.g403 = Garda(self.args.ban_403)
                  self.g422 = Garda(self.args.ban_422, False)
                  self.gmal = Garda(self.args.ban_422)
                  self.gurl = Garda(self.args.ban_url)
          
                  self.log_div = 10 ** (6 - args.log_tdec)
                  self.log_efmt = "%02d:%02d:%02d.%0{}d".format(args.log_tdec)
                  self.log_dfmt = "%04d-%04d-%06d.%0{}d".format(args.log_tdec)
                  self.log = self._log_disabled if args.q else self._log_enabled
                  if args.lo:
                      self._setup_logfile(printed)
          
                  lg = logging.getLogger()
                  lh = HLog(self.log)
                  lg.handlers = [lh]
                  lg.setLevel(logging.DEBUG)
          
                  self._check_env()
          
                  if args.stackmon:
                      start_stackmon(args.stackmon, 0)
          
                  if args.log_thrs:
                      start_log_thrs(self.log, args.log_thrs, 0)
          
                  if not args.use_fpool and args.j != 1:
                      args.no_fpool = True
                      t = "multithreading enabled with -j {}, so disabling fpool -- this can reduce upload performance on some filesystems, and make some antivirus-softwares "
                      c = 0
                      if ANYWIN:
                          t += "(especially Microsoft Defender) stress your CPU and HDD severely during big uploads"
                          c = 3
                      else:
                          t += "consume more resources (CPU/HDD) than normal"
                      self.log("root", t.format(args.j), c)
          
                  if not args.no_fpool and args.j != 1:
                      t = "WARNING: ignoring --use-fpool because multithreading (-j{}) is enabled"
                      self.log("root", t.format(args.j), c=3)
                      args.no_fpool = True
          
                  for name, arg in (
                      ("iobuf", "iobuf"),
                      ("s-rd-sz", "s_rd_sz"),
                      ("s-wr-sz", "s_wr_sz"),
                  ):
                      zi = getattr(args, arg)
                      if zi < 32768:
                          t = "WARNING: expect very poor performance because you specified a very low value (%d) for --%s"
                          self.log("root", t % (zi, name), 3)
                          zi = 2
                      zi2 = 2 ** (zi - 1).bit_length()
                      if zi != zi2:
                          zi3 = 2 ** ((zi - 1).bit_length() - 1)
                          t = "WARNING: expect poor performance because --%s is not a power-of-two; consider using %d or %d instead of %d"
                          self.log("root", t % (name, zi2, zi3, zi), 3)
          
                  if args.s_rd_sz > args.iobuf:
                      t = "WARNING: --s-rd-sz (%d) is larger than --iobuf (%d); this may lead to reduced performance"
                      self.log("root", t % (args.s_rd_sz, args.iobuf), 3)
          
                  zs = ""
                  if args.th_ram_max < 0.22:
                      zs = "generate thumbnails"
                  elif args.th_ram_max < 1:
                      zs = "generate audio waveforms or spectrograms"
                  if zs:
                      t = "WARNING: --th-ram-max is very small (%.2f GiB); will not be able to %s"
                      self.log("root", t % (args.th_ram_max, zs), 3)
          
                  if args.chpw and args.have_idp_hdrs and "pw" not in args.auth_ord.split(","):
                      t = "ERROR: user-changeable passwords is not compatible with your current configuration. Choose one of these options to fix it:\n option1: disable --chpw\n option2: remove all use of IdP features; --idp-*\n option3: change --auth-ord to something like pw,idp,ipu"
                      self.log("root", t, 1)
                      raise Exception(t)
          
                  noch = set()
                  for zs in args.chpw_no or []:
                      zsl = [x.strip() for x in zs.split(",")]
                      noch.update([x for x in zsl if x])
                  args.chpw_no = noch
          
                  if args.ipu:
                      iu, nm = load_ipu(self.log, args.ipu, True)
                      setattr(args, "ipu_iu", iu)
                      setattr(args, "ipu_nm", nm)
          
                  if args.ipr:
                      ipr = load_ipr(self.log, args.ipr, True)
                      setattr(args, "ipr_u", ipr)
          
                  for zs in "ah_salt fk_salt dk_salt".split():
                      if getattr(args, "show_%s" % (zs,)):
                          self.log("root", "effective %s is %s" % (zs, getattr(args, zs)))
          
                  if args.ah_cli or args.ah_gen:
                      args.idp_store = 0
                      args.no_ses = True
                      args.shr = ""
          
                  if args.idp_store and args.have_idp_hdrs:
                      self.setup_db("idp")
          
                  if not self.args.no_ses:
                      self.setup_db("ses")
          
                  args.shr1 = ""
                  if args.shr:
                      self.setup_share_db()
          
                  bri = "zy"[args.theme % 2 :][:1]
                  ch = "abcdefghijklmnopqrstuvwx"[int(args.theme / 2)]
                  args.theme = "{0}{1} {0} {1}".format(ch, bri)
          
                  if args.nid:
                      args.du_who = "no"
                  args.du_iwho = n_du_who(args.du_who)
          
                  if args.ver and args.ver_who == "no":
                      args.ver_who = "all"
                  args.ver_iwho = n_ver_who(args.ver_who)
          
                  if args.nih:
                      args.vname = ""
                      args.doctitle = args.doctitle.replace(" @ --name", "")
                  else:
                      args.vname = args.name
                  args.doctitle = args.doctitle.replace("--name", args.vname)
                  args.bname = args.bname.replace("--name", args.vname) or args.vname
          
                  if args.log_fk:
                      args.log_fk = re.compile(args.log_fk)
          
                  # initiate all services to manage
                  self.asrv = AuthSrv(self.args, self.log, dargs=self.dargs)
                  ramdisk_chk(self.asrv)
          
                  if args.cgen:
                      self.asrv.cgen()
          
                  if args.exit == "cfg":
                      sys.exit(0)
          
                  if args.ls:
                      self.asrv.dbg_ls()
          
                  if not ANYWIN:
                      self._setlimits()
          
                  self.log("root", "max clients: {}".format(self.args.nc))
          
                  self.tcpsrv = TcpSrv(self)
          
                  if not self.tcpsrv.srv and self.args.ign_ebind_all:
                      self.args.no_fastboot = True
          
                  self.up2k = Up2k(self)
          
                  self._feature_test()
          
                  decs = {k.strip(): 1 for k in self.args.th_dec.split(",")}
                  if not HAVE_VIPS:
                      decs.pop("vips", None)
                  if not HAVE_PIL:
                      decs.pop("pil", None)
                  if not HAVE_RAW:
                      decs.pop("raw", None)
                  if not HAVE_FFMPEG or not HAVE_FFPROBE:
                      decs.pop("ff", None)
          
                  # compressed formats; "s3z=s3m.zip, s3gz=s3m.gz, ..."
                  zlss = [x.strip().lower().split("=", 1) for x in args.au_unpk.split(",")]
                  args.au_unpk = {x[0]: x[1] for x in zlss}
          
                  self.args.th_dec = list(decs.keys())
                  self.thumbsrv = None
                  want_ff = False
                  if not args.no_thumb:
                      t = ", ".join(self.args.th_dec) or "(None available)"
                      self.log("thumb", "decoder preference: {}".format(t))
          ... # I hit the Hexbear character limit