Pesistant Storage - Interim Solutions

General forum for server information, questions, and announcements.

Moderators: Wynna, NWN2 - 03 DM

User avatar
NickD
Beholder
Posts: 1969
Joined: Sat Jul 31, 2004 9:38 am
Location: Auckland, New Zealand

Pesistant Storage - Interim Solutions

Post by NickD »

Persistant Storage appears to be working in BG. Therefore I surmise that the reason p-storage in TSM is causing crashing is because TSM has so much of it in use.

1. Would it be possible to selectively clear out p-chests that are no longer in use/owned by dead PCs? Perhaps even clear them all out completely, just so they can be used again. They'd probably all get wiped with the DB solution anyway.

2. Another temporary solution to the problem in terms of PC death would be to make the body non-persistant storage. This means you'd have to carry the body and items separately and it'd all get wiped when the server resets, but it's better than causing crashes whenever someone dies or tries to loot a dead body.

I would suggest looking into implementing 2 above anyway. And after implementing the DB solution for p-storage, convert the body to p-storage object when they log out, rather than what is most likely to be the middle of combat.
Current PCs:
NWN1: Soppi Widenbottle, High Priestess of Yondalla.
NWN2: Gruuhilda, Tree Hugging Half-Orc
User avatar
Brother Humphrey
Kosher Kojak
Posts: 1116
Joined: Wed Aug 18, 2004 12:59 pm
Location: Hadera, Israel

Re: Pesistant Storage - Interim Solutions

Post by Brother Humphrey »

If the first suggestion is the one to be implemented, I'm sure all of us players would appreciate a time period where we could empty our PChests with DM supervision and then store them on a DM avatar so we wouldn't get slowed to a crawl with an extra 300+lbs of gear we have no current need of, but can't get rid of due to needing it for future events.

That said, I would ask AL to search the DB from the time after Knut Horther's death in order to determine what disappeared from Sword Eliisabet Fayth Trueblade's pchest in H.I..
<paazin> Elves I bet are kinda fun to play.
<BH|werksux> I prefer the trumpet or clarinet
<BH|werksux> elves wiggle too much

Current Server: TSM

Current PC: Delshandra
Pwned PCs: Lemuel,Skimmer,Clevon,Juno,Gilbert,BH,Dunkin,Osk & Rodney

Current Status: Highly Mobile
User avatar
Riotnrrd
DMA's Technical Liaison
Posts: 1682
Joined: Sat Jan 03, 2004 2:04 pm

Re: Pesistant Storage - Interim Solutions

Post by Riotnrrd »

I offer support for prioritization of pstorage in TSM.

I am willing to assist as possible.
User avatar
Wynna
Dungeon Master
Posts: 5734
Joined: Sat Jan 03, 2004 10:09 am
Location: Seattle, WA (PST)

Re: Pesistant Storage - Interim Solutions

Post by Wynna »

FYI, AL's out of town this weekend. Thanks for the suggestions. I'm sure he'll respond after some deserved time off.
Enjoy the game
User avatar
NickD
Beholder
Posts: 1969
Joined: Sat Jul 31, 2004 9:38 am
Location: Auckland, New Zealand

Re: Pesistant Storage - Interim Solutions

Post by NickD »

The top solution isn't something for AL to take care of. It's up to the DM team, cleaning up excess storage in the hope of buying AL some more time to implement p-storage.
Current PCs:
NWN1: Soppi Widenbottle, High Priestess of Yondalla.
NWN2: Gruuhilda, Tree Hugging Half-Orc
User avatar
Wynna
Dungeon Master
Posts: 5734
Joined: Sat Jan 03, 2004 10:09 am
Location: Seattle, WA (PST)

Re: Pesistant Storage - Interim Solutions

Post by Wynna »

There's actually very little p-storage on TSM: House Invincible, the Uni, Rhyester's Matins, ...am I missing anything? All the Uni rooms are cleaned out at PC death; I think I've taken care of the H.I. rooms a month or so ago. I can check Rhyster's.
Enjoy the game
User avatar
NickD
Beholder
Posts: 1969
Joined: Sat Jul 31, 2004 9:38 am
Location: Auckland, New Zealand

Re: Pesistant Storage - Interim Solutions

Post by NickD »

It might be that the storage that is there is too full or something, but if NWN2 can't handle a small amount of pstorage then that's just a bit lame.

Or I could be wrong about the cause.
Current PCs:
NWN1: Soppi Widenbottle, High Priestess of Yondalla.
NWN2: Gruuhilda, Tree Hugging Half-Orc
User avatar
Curmudgeon
Gadfly
Posts: 4312
Joined: Thu Oct 07, 2004 12:07 am
Location: East coast US

Re: Pesistant Storage - Interim Solutions

Post by Curmudgeon »

According to my probably incomplete understanding of AL's explanation, the p-storage issue is due to a problem with the NWN2 database system that came with the game (a rather clunky system built by Bioware and imported wholesale into NWN2) having problems writing to a fairly remote storage vault. You may recall that TSM's p-storage issues were minimal until we connected to the Remote Vault immediately preceding BG going Live. TA and IA have been working on a possible fix for this, but there have been some technical issues with the initial proposed fix.

An alternate fix may be possible, but it would require migrating the functions of the built-in database to an alternate scheme - it would perhaps help if we had an ALFA member who has some skills with MySQL who could step forward and offer to assist our overworked Tech Team.

BTW, the reason BG has so few issues with p-storage is that the module server is geographically and latency-wise very close to the db server.

If I understand all this right, I am afraid that emptying the currently used pchests will not have any effect on the problem.
- Curmudgeon
HDM ALFA 03 - The Silver Marches
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
"Maxim #12: A soft answer turneth away wrath. Once wrath is looking the other way, shoot it in the head." - The Seventy Maxims of Maximally Effective Mercenaries

"This is not my circus. These are not my monkeys."

Realmslore: Daily Dwarf Common
User avatar
NickD
Beholder
Posts: 1969
Joined: Sat Jul 31, 2004 9:38 am
Location: Auckland, New Zealand

Re: Pesistant Storage - Interim Solutions

Post by NickD »

Ah. Well then...

I don't have experience with MySQL, but I do have a fair bit of database experience. I offered some advice in that regard at the start of the trouble, but haven't heard anything recently.
Current PCs:
NWN1: Soppi Widenbottle, High Priestess of Yondalla.
NWN2: Gruuhilda, Tree Hugging Half-Orc
danielmn
Fionn In Disguise
Posts: 4678
Joined: Sat Nov 05, 2005 9:08 pm

Re: Pesistant Storage - Interim Solutions

Post by danielmn »

Tower of Balance should have P-storage as well.
Swift wrote: Permadeath is only permadeath when the PCs wallet is empty.
Zyrus Meynolt: [Party] For the record, if this somehow blows up in our faces and I die, I want a raise

<Castano>: danielnm - can you blame them?
<danielmn>: Yes,
<danielmn>: Easily.

"And in this twilight....our choices seal our fate"
User avatar
AcadiusLost
Chosen of Forumamus, God of Forums
Posts: 5061
Joined: Tue Oct 19, 2004 8:38 am
Location: Montara, CA [GMT -8]
Contact:

Re: Pesistant Storage - Interim Solutions

Post by AcadiusLost »

Erg, lots to clarify here:

Persistent storage currently uses the (lousy, buggy) "campaign database" system that shipped with NWN1, and was left as it's same buggy self in the NWN2 game code. It was never really meant to manage the sorts of things we use it for.

The native campaign DB is stored in the /database folder of the server hosting computer, so it's not sensitive to latency between the host machine and the SQL server. If/when we move to SQL-object-based p-storage (currently the most promising route, implementation incomplete), this will become a factor.

Number of storage objects does not appear to be the determinate in this case. I've tried experimentally deleting all but a handful of storage object records, and the problem persists. (Also, recall that PC corpses are p-storage objects, so TSM has had many hundreds of them over the 14 months of Live in addition to those toolsetted).

The issue is more likely tied to the memory footprint of the server itself; TSM tends to fill about 1.6 gigabytes of server memory all by it's lonesome. When the campaign database functions are invoked for a "write" (closing a p-chest after modifying the contents), the server process may be trying to allocate more RAM for it's (highly inefficient) operations, and running into hard limitations, causing the server crash.

We could "disable" p-chests themselves centrally, so they appear empty and would not attempt to save contents (but the contents would be saved for when things are working again), but it's troublesome (would mean making a special version of our script hak for TSM, and making sure that copy was in place each time the mod is recompiled) and would still give us problems with the death system, since PC inventory might be lost OnDeath without the system there to hold on to it. For a while at least, the gear was staying with the PC in the fugue plane when the DB failed. Now, I'm not so sure.

I know it's a pain, but so is the workaround. I'd feel better sinking the time into the SQL-based reimplementation than into interim fixes. Realistically though, the SQL-based storage isn't going to be done until late June at the earliest, given my travel plans.

Your patience is appreciated.
User avatar
Brother Humphrey
Kosher Kojak
Posts: 1116
Joined: Wed Aug 18, 2004 12:59 pm
Location: Hadera, Israel

Re: Pesistant Storage - Interim Solutions

Post by Brother Humphrey »

We've waited this long, pal, we can wait some more. Even having given us an ETA is an improvement on the mushroom method. Thanks for all your time and effort on behalf of all of us incompetent slobs (and the rest of you competent types) who would otherwise just continue doing what we can to insure that we don't crash the server by getting themselves killed.

*Doles out patience to those in short supply*
<paazin> Elves I bet are kinda fun to play.
<BH|werksux> I prefer the trumpet or clarinet
<BH|werksux> elves wiggle too much

Current Server: TSM

Current PC: Delshandra
Pwned PCs: Lemuel,Skimmer,Clevon,Juno,Gilbert,BH,Dunkin,Osk & Rodney

Current Status: Highly Mobile
User avatar
AcadiusLost
Chosen of Forumamus, God of Forums
Posts: 5061
Joined: Tue Oct 19, 2004 8:38 am
Location: Montara, CA [GMT -8]
Contact:

Re: Pesistant Storage - Interim Solutions

Post by AcadiusLost »

Had an inspiration on this last night, too soon to say for sure, but that patience might not have to be very much longer at all... :chin:
User avatar
Kest
Builder
Posts: 794
Joined: Sat May 22, 2004 9:20 pm
Location: Flint, MI

Re: Pesistant Storage - Interim Solutions

Post by Kest »

AL is a marvel to behold in action

even when im afk most of the time
User avatar
Brother Humphrey
Kosher Kojak
Posts: 1116
Joined: Wed Aug 18, 2004 12:59 pm
Location: Hadera, Israel

Re: Pesistant Storage - Interim Solutions

Post by Brother Humphrey »

YOU MAY NOW DIE AT WILL! AL'S DA MAN! :party1: :party2: :party3: :trophy: :yarr:
<paazin> Elves I bet are kinda fun to play.
<BH|werksux> I prefer the trumpet or clarinet
<BH|werksux> elves wiggle too much

Current Server: TSM

Current PC: Delshandra
Pwned PCs: Lemuel,Skimmer,Clevon,Juno,Gilbert,BH,Dunkin,Osk & Rodney

Current Status: Highly Mobile
Post Reply