Im also having this problem when im mass uploading (via Mystic and not MUTIL) very large folder with 10k+ files.

Ahh okay, so this is from a mass upload while logged in, not MUTIL!

Gotcha thank you I will check into that.

--- Mystic BBS v1.12 A39 2018/04/21 (Windows/32)
* Origin: Black Flag <ACiD Telnet HQ> blackflagbbs.com (10:101/2)

I am not sure the problem is with massupload. But one thing I noticed is massupload does not upload all the files in 1 run. For large batches, I may need to run it a couple times and uploads files at each run until there is 0.

Yeah that is not normal. It may be unrelated to the other issue but either
way both need to be sorted out for sure.

Have you ever used the online mass upload? I wonder if the same problems exist.

I do a file toss and a pack every 3 hours to process any inbound fdn
files and delete the one that got replaced.

Okay this is a good start. The packing should be done with everything
offline, its meant to be done like maybe once a week or month or so but I suppose running it that often shouldn't cause a problem. Its just that if there is something else accessing the file base at the same time I think it could result in data loss.

Its been quite a while since I looked at any of this stuff so I will start by reviewing the code and then I'll do some mass uploads of a bunch of files to see if I can notice anything.

I looked at the logs and I don't see anywhere that large amount of files got deleted as part of the process.

Yeah really sounds like a bug that needs to be address! So I don't think you'll find much in the logs.

I will setup a cron to watch file fbase.dat file size to pinpoint exactly when it happen, this will help me figure out which process may have triggered it and give you some more precise answers.

Okay let me know if you figure out any clues and I will see what I can reproduce as well. We'll get it sorted out, hopefully sooner than later!

--- Mystic BBS v1.12 A39 2018/04/21 (Windows/32)
* Origin: Black Flag <ACiD Telnet HQ> blackflagbbs.com (10:101/2)

I am not sure the problem is with massupload. But one thing I noticed massupload does not upload all the files in 1 run. For large batches, may need to run it a couple times and uploads files at each run until there is 0.

Yeah that is not normal. It may be unrelated to the other issue but either way both need to be sorted out for sure.

Have you ever used the online mass upload? I wonder if the same problems exist.

No, when I upload, I usually upload large batches so it's easier to add a FILE_ID.DIZ file into each and put them in the folder for mass upload. Individual files uploads are working as supposed.

I do a file toss and a pack every 3 hours to process any inbound fdn files and delete the one that got replaced.

Okay this is a good start. The packing should be done with everything offline, its meant to be done like maybe once a week or month or so but I suppose running it that often shouldn't cause a problem. Its just that
if there is something else accessing the file base at the same time I think it could result in data loss.

Ok, with this in mind, I will make a separate cron job for this and watch for semaphores before running it to ensure noone is logged in. I have remove the packing from everything and will wait for a couple of days if this can be the cause. Maybe the file packing could have the same precautions the userbase packing has and refuse to run if users are logged in?

Its been quite a while since I looked at any of this stuff so I will
start by reviewing the code and then I'll do some mass uploads of a
bunch of files to see if I can notice anything.

Ok, I will report back any new information I have.

I will setup a cron to watch file fbase.dat file size to pinpoint exa when it happen, this will help me figure out which process may have triggered it and give you some more precise answers.

Okay let me know if you figure out any clues and I will see what I can reproduce as well. We'll get it sorted out, hopefully sooner than later!

Excellent, thanks!

|15 ß Þ |15StackFault |08<|03.|11.|15P|11h|03EN|11o|15M|11.|03.|08>
|11 Ý ß |11The Bottomless Abyss BBS
|03 ß Ýß |03ssh|08.|072222 |08/ |03telnet|08.|072023 |08/ |03https
|08 ÜþÞ |08bbs|07.|08bottomlessabyss|07.|08net

--- Mystic BBS v1.12 A39 2018/04/21 (Linux/64)
* Origin: The Bottomless Abyss BBS þ bbs.bottomlessabyss.net (10:102/3)

No, when I upload, I usually upload large batches so it's easier to add a FILE_ID.DIZ file into each and put them in the folder for mass upload. Individual files uploads are working as supposed.

Mystic has an online mass upload as well, it works just like the MUTIL
version but it allows you to optionally have a bit more interaction. I am
not sure of the menu command off hand but it will be in the list in the menu editor.

I was wondering if that also failed for you or not. If it doesn't maybe I
can compare the two and note what is different about them.

Ok, with this in mind, I will make a separate cron job for this and
watch for semaphores before running it to ensure noone is logged in. I have remove the packing from everything and will wait for a couple of
days if this can be the cause. Maybe the file packing could have the

I think that might be a good idea to help narrow things down, thanks.

There was a time where the packers would refuse to run if the BBS was loaded and maybe that is something I should consider doing again. Both the message base packer and file base packer completely rebuild the data and then replace the old with the new, so I am sure you can imagine that things could get a little strange if something is accessing the data while the packers are
trying to replace it.

I will be setting up some tests today to see if I can track anything down.

--- Mystic BBS v1.12 A39 2018/04/21 (Windows/32)
* Origin: Black Flag <ACiD Telnet HQ> blackflagbbs.com (10:101/2)