User avatar
JoeUser
Dallas, TX

Posted Sun Jun 09, 2024 8:14 pm

Over the years I've acquired some miscellaneous user group floppy collections from online auctions, scattered amongst other disks in bulk purchases. I'll have to go through the boxes of floppies and cull out the user group disks to get an idea of how many I have. I haven't had a chance to even boot any of them up to see just what's on them, mainly due to lack of free time (explains my absence from this forum, as well).

However, I would gladly contribute to the cause, solely for the reason that they would be archived digitally and also available to everyone, as they should be. You're correct, Eric, in that these disks should be preserved for their historical and human interest value, and to provide a snapshot of time of the past activities of the Amiga community. I truly enjoy the treasure hunt for software, even more so than finding hardware, so I'm always on the lookout for unique and rare software/manuals.

Just let me know how to contribute, I'd be happy to do so.

User avatar
Zippy Zapp
CA, USA

Posted Mon Jun 10, 2024 9:23 am

JoeUser wrote:
Sun Jun 09, 2024 8:14 pm
However, I would gladly contribute to the cause, solely for the reason that they would be archived digitally and also available to everyone, as they should be. You're correct, Eric, in that these disks should be preserved for their historical and human interest value, and to provide a snapshot of time of the past activities of the Amiga community. I truly enjoy the treasure hunt for software, even more so than finding hardware, so I'm always on the lookout for unique and rare software/manuals.

Just let me know how to contribute, I'd be happy to do so.
That is cool. Do you have a way to image the disks? Say with a Grease Weazle or something like that?
I think for these type of disks an ADF is fine.

User avatar
intric8
Seattle, WA, USA
YouTube

Posted Mon Jun 10, 2024 12:49 pm

Even something as basic as David Dunklee's excellent "Disk2ADF" program would be great.

I'd be very curious which user groups are represented and quantities. If any of the disks have custom printed (usually via dot-matrix) stickers with their logos, photos of those disks would be tremendous, too. We will be able upload images/logos for each Set - even if a given set = 1 disk.

:disk:

User avatar
McTrinsic

Posted Thu Jun 13, 2024 11:43 am

I can also help, I am in Europe though. I have a Kryoflux here.

User avatar
A1-X1000
Toronto, Canada

Posted Thu Jun 13, 2024 7:39 pm

cool idea :check: :boing: <3

User avatar
JoeUser
Dallas, TX

Posted Thu Jul 11, 2024 7:39 pm

I've got a Grease Weazel, just haven't assembled it in for mounting in its case yet. I haven't even explored creating ADF's, and that would likely be the best way to image individual disks, I would think.

However, once I get the GW functioning the files on each disk can be bundled in a zip file on a PC, then emailed or uploaded. I think if that approach is taken then whomever wants to create ADF's can do so, if desired. Or, if they have a GW then they can simply unzip the contents and copy them to a formatted Amiga disk.

In any case, I need to gather the boxes of floppies I've collected over the past few years and begin to go through them in earnest. I can't believe how many disks I've collected over the past three or four years, but they number in the hundreds. And, they really need to be archived to less volatile media (after verifying that the disks are still readable). Amongst that large collection I know that I have user group disks, just can't recall how many or if they are complete collections (it's likely they're disks from differing collections, no complete sets).

User avatar
intric8
Seattle, WA, USA
YouTube

Posted Fri Jul 12, 2024 10:19 pm

I know that I have user group disks
I'd be very curious which ones, as in the cities/locales and years.

User avatar
Zippy Zapp
CA, USA

Posted Sun Jul 14, 2024 7:00 pm

intric8 wrote:
Fri Jul 12, 2024 10:19 pm
I know that I have user group disks
I'd be very curious which ones, as in the cities/locales and years.
Same here.
JoeUser wrote: However, once I get the GW functioning the files on each disk can be bundled in a zip file on a PC, then emailed or uploaded. I think if that approach is taken then whomever wants to create ADF's can do so, if desired. Or, if they have a GW then they can simply unzip the contents and copy them to a formatted Amiga disk.
I think with the GW, unless you are selecting raw flux images IE SCP format then ADF is the image format of choice for regular Amiga disks. That way it can detect bad sectors, etc. With the GW, I don't think you can extract the contents of the disk into files on the fly. It is an imaging solution and you would use one of the 2 formats as per above. ADF would use the least amount of space (880kb) and Flux images would use the most space (many megabytes each disk). Once saved as an image you could extract contents using an emulator or other software but if you are imaging it then there would be no need for someone to image it after the fact, If I get your meaning?

If you need help with the imaging, I am in California and have an image station setup at my office dedicated to imaging C64/128, Amiga and PC disks so I can certainly help.

User avatar
intric8
Seattle, WA, USA
YouTube

Posted Sat Sep 07, 2024 10:53 am

Hey folks,

I know it has been quiet around here lately but that's not due to a lack of projects or things to do. I wanted to give an update on some of this work and the new site section.

My amazing partner that has been building things out is nearly ready for our initial release. While he finishes laying down the foundation and erecting the walls, I come in behind him and check to make sure things are all nailed down (QA). We've had a very good collaboration on how things could work, and the truth is most of the heavy lifting is behind the scenes and out of public view - the Content Management System. The CMS allows me to add new content to this area of the site. It's very complex and quite sophisticated.

You've not seen anything pop up here yet because archiving these stacks and stacks of disks actually is quite time consuming. Last weekend I spent a day learning the process from end to end. By the end of the day I'd completed 4 issues of a disk magazine. The following is an example of doing one single issue from Amiga Animation disk magazine, which contains 3 disks per issue:
  • Pop each disk in the Amiga and use David Dunklee's "Disk2ADF" program to create ADFs of each disk. You all know how slow that process is. Do that 3 times.
  • Scan the front and back of the disk magazine's "covers". The front is what you'd see at the store or when you received it in the mail. The back contains very detailed descriptions of most of the software and files found on each disk. I scan the front and back at 100dpi using a flatbed scanner, which is purely to produce decent but non-printable web JPEG graphics. I then re-scan the back cover at 300 dpi so I can use OCR software on all of the text.
  • Import the 300dpi PDF into Adobe Acrobat (online version, which sadly I discovered after multiple tests that it has better OCR results than the stand-alone desktop software!). Convert the text found in the image, then copy/paste all of that text into a barebones text file.
  • Correct all of the line breaks and garbled typos - there are a lot, even in 2024. If you've ever seen a text-converted magazine from Archive.org and seen the pages of broken jank (which they don't fix) you know what I'm talking about here.
  • Scan the physical disks as a single 100dpi JPEG.
  • Go to AmigaLove.com and upload the front cover as a thumbnail, then upload the ADFs and give them all descriptions. Upload the back cover and disk JPEG. Copy/paste the converted text into the content area and fill in all the other text details (subtitles, year published, etc.)
That right there can easily take 60 minutes for a single issue, if not longer. It's not "work work" but it's non-trivial time spent. I have to know I've got a pretty good time window available before jumping into one of these.

Bonus:
There is a very cool program my partner installed and configured that allows me to "scan" an ADF file's disk contents. This is very cool, because it can output a Disk Preview of 1 disk on a given page (not all 3, like with some disk magazines). A Disk Preview is essentially a visual output of every file found on a disk.

Any document file becomes visually exposed so that you, the reader, can consume it without even downloading an ADF. You can read every single document file, you can see images found on the disk (IFFs, etc.) and see the directory structures, all within the content page of a single archive. It's incredibly cool and frankly hard to explain. So I will show you below.

Some disks have so many files this preview can sometimes be overwhelming. So we're currently talking about ways I can clean out and edit the file structures to only leave behind parts you may find interesting. This is more time consuming but produces a better product at the end of the day.

Here are some snapshots of some of the content pages to help you see what's coming.

Landing Page
This is the front door of the Software Archive where you can either search, or more realistically browse and discover rare Amiga content based on the collection type or timeframe you're interested in.
landing_page.jpg
Note the new link in the site header.


Collection/Disk Type Page
This is the top level of a given collection, if applicable. In this example, this is the top page of the disk magazine Amiga Animation, which then contains every single volume and issue I'm able to attach to it. The only thing this doesn't have, unfortunately, is a way to "subscribe" to a collection so when I add new issues/disks you could be notified. However, in the short term I'll probably add those updates over here in Site News whenever I add a new batch just so folks have a clue there's more to see.

This page currently has the potential to become quite large and heavy as years of issues are added, so we may have to find ways to optimize that in the future. Time will tell.
collection-page.jpg

Issue/Disk Page
This is an example of an individual issue, Volume 4 Issue 2 from 1990 of Amiga Animation. This is where the real magic happens.

Hopefully now you can start to see why taking the time to use OCR software to pull all of the text off the magazine covers is so important. Not only can you more easily read all of the contents of a given issue, but it's now also searchable. If I just left it baked into the images it would be borderline useless.
disk-page.jpg

Disk Preview

This is an example of some of what's exposed when a Disk Preview is generated from an ADF file, which would be below the image gallery area on the Disk Pages.
disk-preview.jpg
Some of the really long text files can create a bit of a scrolling challenge, but it's a small price to pay for the amount of content this makes available.

This will be especially valuable for single-disk uploads like User Group monthly disks and individual stand-alone shareware/freeware disks. It will save everyone so much time to literally examine the contents of a disk without even having to take it over to their Amigas or emulators unless they are completely convinced to do so.

To be honest, I think many of these disks by being unfurled this way will create very enjoyable past-time browsing and reading just as they are here on the site. Pretty cool, right?

With all of this said, I currently have a measly 4 issues added so far. Once I've completed all of what I own of Volume 4 (1990) for Amiga Animation, I will likely expose it publicly. Then there are all of the other Volumes of that magazine I've bought and collected over the years (I don't own every single issue but I own a lot and none of them are online), and all the other collections and disks I want to archive here. This will be a multi-year project but a very fun and meaningful one.

@JoeUser:
If you want to ship me any User Group disks for archiving, I can move those to the top of the queue and mail them back to you in a few weeks/months afterwards. I don't think UserGroup disks will take nearly as long to do since it eliminates the entire scanning/OCR element from the process. DM me and we can work it out.

User avatar
intric8
Seattle, WA, USA
YouTube

Posted Sun Sep 15, 2024 2:53 pm

Been very productive this weekend and the prior week.

As of right now, 34 individual issues across 3 disk magazine titles have been fully scanned and imaged.

IMG_8251.jpg
These 34 Disk Magazines are mainly "Amiga Animation" but also include a few issues from "Best of Amiga" and "Amiga Games" magazines.

This includes:
  • 93 separate ADF files created.
  • Front and back cover scans on the flatbed scanner: 68 images
  • + 34 extra hi-res PDF scans. I do this so I can run OCR software on the results. Then I fix the text it spits out by hand.
  • + 34 scans of all physical disks (this will be more important for other disk types, but I wanted it to be part of my process for all disks added).
Looking forward to getting all of this entered into the CMS these next few weeks. :bruce: :disk:





Return to “Site News”