Possible import of some EAv2 threads

[Neutrum260725]

Good morning everyone,

I can access the link, but I can't reply. How should uploads work in the future? Where should the upload be sent? I think sending it as a ZIP file would be the most practical solution.

Greetings to all

[WheelyFixed]

Thanks Fhunter, probably should give Neutrum full access as well if that can be done w/o changing his status on the rest of the forum...

WheelyFixed

[fhunter]

Thanks Fhunter, probably should give Neutrum full access as well if that can be done w/o changing his status on the rest of the forum...

WheelyFixed

Done. Also - unlocked the forum.

[Neutrum260725]

Testing the function, looks good.

What should the upload process look like?

[WheelyFixed]

I'm not really sure what it should look like... Fhunter may be able to provide some guidance about the way the back end works...

IMHO the 'perfect' end result would be a thread that looks like it was posted natively here, or close to it, preserving individual messages, quotes, etc. I can imagine other results that would be not quite as nice, but still be usable. But how to get to that result is above my skill set.

WheelyFixed

[Neutrum260725]

So that everyone interested knows what this is about, here's a screenshot of a thread from EAv2.

Neutrum260725

[Neutrum260725]

As far as I know, fhunter's script was designed to allow users to copy the stories completely and download them as a zip file. That's exactly what I did back then, but I also started copying the archived threads from the actual Eunuch Archive to my PC. Since that was quite time-consuming, I couldn't copy everything. My copies are genuine EAv2 threads, which can only be read individually in each browser, just like the original. The missing avatars are probably due to the need to save storage space, and new posts are naturally not possible. The total size of the archive data alone is around 800 MB, significantly more than the data contained in the stories. I've attached the "Blogs & Life Stories" section as a zip file so that anyone with access can see for themselves. Other sections are probably much larger, so I've included a smaller one as an attachment for now.
neutrum260725

[WheelyFixed]

As far as I know, fhunter's script was designed to allow users to copy the stories completely and download them as a zip file. That's exactly what I did back then, but I also started copying the archived threads from the actual Eunuch Archive to my PC. Since that was quite time-consuming, I couldn't copy everything. My copies are genuine EAv2 threads, which can only be read individually in each browser, just like the original. The missing avatars are probably due to the need to save storage space, and new posts are naturally not possible. The total size of the archive data alone is around 800 MB, significantly more than the data contained in the stories. I've attached the "Blogs & Life Stories" section as a zip file so that anyone with access can see for themselves. Other sections are probably much larger, so I've included a smaller one as an attachment for now.
neutrum260725

I have the story archive, and a zip of the forum that someone made and got something similar to what you posted in that screenshot, where they didn't show what parts of the the messages were quotes from earlier ones in the thread....

I don't know if you missed attaching the attachment, or if it doesn't show up here for some reason, but I'm not seeing it...

WheelyFixed

[dandelion]

It'll be nice to see your version of the scrape. fhunter ran a scrape for the forum too. But quotes are included as plain text along with post contents, making it somewhat difficult to read.

I don't see your zip file unfortunately.

As far as I know, fhunter's script was designed to allow users to copy the stories completely and download them as a zip file. That's exactly what I did back then, but I also started copying the archived threads from the actual Eunuch Archive to my PC. Since that was quite time-consuming, I couldn't copy everything. My copies are genuine EAv2 threads, which can only be read individually in each browser, just like the original. The missing avatars are probably due to the need to save storage space, and new posts are naturally not possible. The total size of the archive data alone is around 800 MB, significantly more than the data contained in the stories. I've attached the "Blogs & Life Stories" section as a zip file so that anyone with access can see for themselves. Other sections are probably much larger, so I've included a smaller one as an attachment for now.
neutrum260725

[dandelion]

I tinkered with it a bit, and made some pretty good progress on a test phpBB instance on my private server. See screenshots below.

Since the scrape I worked with did not separate quotes from replies, I had to programmatically look for repeated paragraphs within each reply and look up the original author. It seems to have worked quite well, but we should perhaps do more in-depths double checking.

Things I need:
1. @fusion or @fhunter: Can you replicate the site onto a separate VM or container that I can test with? I'll need these access for the test site
1.1 Admin access to phpBB
1.2 SFTP
1.3 SSH, not sure if I need root because I did everything on my test server with root access
1.4 Access to VM's snapshot so I can revert back to the pre-import state and rerun as I refine my script
2. Some volunteers to help check for completeness, errors, and bugs with quote identification
3. Once the technical parts are done, we can discuss where and how to integrate old threads into the forum