PT2SQLite

[Gregoo]

After messing a bit around with the .dat/.war file compression for the item table, I finally found how it was working.
I made a tool while I was at it.

PT2SQLite.
This program opens every .dat file in the userdata folders, and every .war file in the warehouse folders, extract every item and insert it in a local SQLite database.

Once you've generated the item database, you can use one of the many existing SQLite browsers to perform selections with more or less complex filters to locate specific items in your server.

The idea of the program came up after some nasty items were discovered on the official PT servers (

To view the content, you need to sign in or register

). There was no tool for that specific task

The program was written in VB6. As usual, I'm releasing it with its source. It's on GitHub this time (I was tired of Gitorious being sluggish) under the mighty

To view the content, you need to sign in or register

license. You can poke around in the source code if you're curious.
There's a few cool procedures there to read binary files, extract byte/word/dword from a byte array, convert dword to float, etc.

I'll write a bit about how the compression is handled later if I have time. The procedures converting .dat/.war files item tables to their expanded versions are located in the dat.bas and war.bas files.

A special thank here for SunnyZ for his enthusiasm and beta tests, and for liaising with the Subagames GM.

Repository:

To view the content, you need to sign in or register

Downloads:

To view the content, you need to sign in or register

PS: I'm dropping a few screenshots here, they aren't up to date.

 

[SunnyZ]

This program is FANTASTIC!

Thank you Gregoo for all your hard work and dedication! It will not go unnoticed

I made this tutorial video for this program not to long ago:

To view the content, you need to sign in or register

Scrap the first part about copying the DataServer folder, that's not needed, but the rest is good info.

 

[Vormav]

sorry to bump but, how can I make the other way arround? how can I compress an item?

You need to remember that if you add something to item that was not there before it will change item size and also checksum.

 

[SheenBR]

no, I mean, gregoo's code wiill generate a decompressed item struct with size 0x214, and if I remember, different than the item packets I guess.

I still wanna know how to compress and where the server generates the new checksum :/:

 

[Piucco]

Wrong offsets/values:

 

[bobsobol]

Those strings should not be found in a standard server. Is it possible that your server is not compatible with this code? (Sadly, I'm away from home for a couple of days yet again, and can't check either the source, or heavily translated servers right now)

Modified servers, with item tables in added PE sections and such may well need constant offset pointers updating, and the binary re-compiling.

 

[SunnyZ]

The download links are down, so I thought I would re-upload them, source code included.

Download:

To view the content, you need to sign in or register

(Also available as download from Rage Zone's server below)

Video Tutorial:


SQLite Database Browser:

To view the content, you need to sign in or register

I know I should not have bumped this old topic, but it is still useful, and its downloads had expired.
All credits to the wonderful master Gregoo!

 

[Gregoo]

Ha, my bad! I renamed the repo some time ago, I forgot to update wherever it was linked o:
I've edited the original post