|
|||||
|
| Porn Users Forum » My Custom Software |
| 1-23 of 23 Posts | Page 1 |
| Thread Nav : Refresh Page | First Post | Last Post | Porn Forum Home |
| 09-10-08 05:25am - 5947 days | Original Post - #1 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
My Custom Software Hi, guys, sorry I've not posted anything in a while. Anyways, I started collecting porn many MANY years ago. I started with mags, then got a flat bed scanner and started scanning my collection, which resulted in thousands of JPG files spread across hard drives and CD roms. Then at the end of 2005 I started collecting internet porn. This resulted in thousands of ZIP files and I started thinking about writing a software app to manage my internet collection. So since 2005 I've been working on a download manager\picture browser\backup software app to help me manage my collection. The software is err, messy, it does what I need it to do and development is now at a crawl. The download manager works with a lot of sites I've joined. Some sites did not work at first but I've been able to make modifications to the code or sometimes write a download manager for a specific site. Anyway I've been using TBP for a while and eventually joined the PU forum a few months back because I wanted to ask\talk about\share my application with other porn lovers. | |
|
||
| 09-10-08 05:33am - 5947 days | #2 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
To give you an idea about how effective my software is here are some numbers (I've been collecting since about december 2005) Total photosets : 136,639 Total images : not sure of exact figure but > 10,000,000 Total disk space : 3.4 TERABYTES Total backup DVDs : 793 The most recent module Ive started working on is a 'duplicate photoset' detector my collection contains about 5000 duplicate photosets from various sites such of Twistys, sexybabes.com, atk etc These sites are not 100% exclusive so duplicates are to be expected. Also, I do collect videos (sometimes). My software contains a small amout of stuff for vids but its not functioning yet. So, the point is, I would like to bring my software into this community. I would need to do some work on it first (an installer for a start). If you could have a download manager\database manager written by a porn lover for porn lovers what features would you like........ | |
|
||
| 09-10-08 06:28am - 5947 days | #4 | |
|
mr smut (0)
Active User  Posts: 107 Registered: Dec 27, '07 Location: Germany |
Oh, wow! I was just about to get mad today because I'd need a newer picture viewer/manager application. I don't care for the rest but what I'd need was an application that can browse, open, update and create ZIP files plus it would need to handle directories which large amounts of files up to 50,000 and more in one single directory. I joined some sites at southerncharms.com and their approach to store the picture sets is still lousy. Anyhow I'd like to learn more about your software it sounds quite interesting and I guess you'll get some good feedback here in the forums. Cheers, Smut | |
|
||
| 09-10-08 06:44am - 5947 days | #5 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
Hi mr smut. I'll give you some more info. When I started collecting internet porn I ended up with lots of zips just like you stored in a directory structure. from a safety point of view THIS IS BAD A single corruption early in the directory tree can ZAP the entire tree, and if its real bad chkdsk wont save you. So when I first started planning my software I decided on a custom database format rather than using zips and directories. this is how it works step 1 ------ you use the download manager (like any other) to add the zips into a download list OR if the site does not offer zips (i.e. you have to right click save right click save....) then the download manager uses a special tools which I've called the 'photoset series detector'. You right click the first image in the series but instead of 'Save as' you send it to the download manager and it will detected the entire series and add each JPG into the download list. If the site offsers (small multi part zips) i.e atk then the download manager will detect all these small zips together. step 2 ------ start the download manager list. This is a list of the ZIPS, JPGS and multi ZIPS created from step 1. Click the download button and the download starts. When the download is complete, click the process button. Process ------- Each zip is broken down into its individual JPGS a new file is created ????.PDP (which stands for Porn Database Photoset). All the individual JPGs from the zipped photoset are reassempled to the PDP alongwith thumb nail images for the photoset and various other info suze as image demensions etc. Now the database divided into DVD sized folders. The new PDP file goes into a folder, if the folder is too big to fit on a DVD a new folder is created so the following structure is created G:\Porn Database\Discs\Disc 0001\?????.PDP G:\Porn Database\Discs\Disc 0001\?????.PDP G:\Porn Database\Discs\Disc 0001\?????.PDP G:\Porn Database\Discs\Disc 0001\?????.PDP . . . . . G:\Porn Database\Discs\Disc 0001\?????.PDP G:\Porn Database\Discs\Disc 0002\?????.PDP . G:\Porn Database\Discs\Disc 0002\?????.PDP Edited on Sep 10, 2008, 07:06am | |
|
||
| 09-10-08 06:45am - 5947 days | #6 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
each directory will fit onto a dvd so the backup tool is easy to use. Once the photoset is part of the database you NEVER have to worry about ZIPS, JPGS ever again. You use the photoset browser to seach you collection. | |
|
||
| 09-10-08 06:53am - 5947 days | #7 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
I've decided to call each site a 'collection' so all the photosets from metart go into the MetArt collection and all the photosets from Babes.TV go into the Babes.TV collection etc but the storage structure on the HD knows nothing about this the database knows where to find each photoset. When the HD is full you simple add a new HD, tell the software about it and the database will grow onto the new HD. The software keeps track of what folder\DVD needs to be backup up. You just insert a blank dvd, click a button and the new stuff is backup. it then tells you what to label the disc. I.e. 'PD Disc 753'. Theres a simple tool called 'photoset reduction'. This takes a PDP file (a photoset) and removes 75% of the images (keeps the first 1 of every 4) to save disk space. You can only do this to a photoset AFTER you backup it up on DVD to prevent you from erasing photos. more info later... | |
|
||
| 09-10-08 06:54am - 5947 days | #8 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
Also because you already have a collection of ZIPS on your HD you could use the 'Manual Download Manager' which allows you to convert an existing collection into the PDP format. | |
|
||
| 09-10-08 07:31am - 5947 days | #9 | |
|
mr smut (0)
Active User Posts: 107 Registered: Dec 27, '07 Location: Germany |
Hello ByteMaster, please don't get me wrong. I think that this is a very cool and modern approach you are using but I'm used to ZIPs and yes I know about the trouble you can get into. Therefor your annotations on the risks of using ZIP files are correct. I love to have ZIPs for each photoset and I do so because it reduces the backup time over network or USB connections. I don't use DVDs but an external backup server plus 3 USB HDDs with 500-640GB each. Can't say why but those manual backups are like a celebration for me. I always sort out what I don't like and make sure to have 2 recent updates for each site I really like. | |
|
||
| 09-10-08 07:39am - 5947 days | #10 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
So imagine you have your entire collection accessible with a single simple to use browser\viewer (no directories to wade through) what ways would you like to search it? Currently the software allows me to search via model name, view in alphabetical order. I've also started working on a graphs and charts module which will allow me to keep track of how fast the database is growing, which sites\collections contain the most photosets\most disk space, the amount of money spent, membership periods, duration since last membership. | |
|
||
| 09-10-08 07:57am - 5947 days | #11 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
Hi mr smut, its not that I dont like zips, but can you explain to me how you browse your collection, what tools do you use. (i need to upload some screen shots) but this is how my system works at the moment. the database as explained is stored in PDP files (from a user point of view you dont need to think about HOW the data is stored) so, you start my browser which presents the entire database as a list of thumb nails (one thumb for each photoset) just like the actual websites do. You search\scroll for a photoset and click its thumb. A window opens showing the entire photoset as thumbs, click a thumb and that image appears. So its just like browsing a BIG website with everything in one place. The system includes a backup engine which uses DVDs (or CD, blueray anything the Nero rom can write to). BUT you could just copy it across onto a backup HD as you do. | |
|
||
| 09-11-08 09:52pm - 5946 days | #12 | |
|
badandy400 (0)
Active User  Posts: 869 Registered: Mar 02, '08 Location: ohio |
How close is all this stuff to completion? It sounds like something I would not mind trying out. "For example, badandy400 has taken it upon himself to become the one man Library of Congress for porn with a collection that surely will be in Guinness Book of World Records some day." ~Toadsith~ PU Interview | |
|
||
| 09-12-08 03:25am - 5945 days | #13 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
Hi badandy400, the code is stable but the user interface is a bit clunky at the moment. The download manager is working (works very well in fact) and the photo browser works but is VERY VERY basic. The database is presented as a large list of thumbnail images along with the model name under each thumb. You use the mouse scroll wheel\scroll bar to move up and down the list, clicking on thumbnail opens that phtoset, which is presented as another list of thumbnail images. Clicking on a thumbnail opens the fullsize image. You can also search the database by model name, so typing say 'Penny Flame' will display all the photosets for her, or you can filter the list by site name. I promise, I will post some screen shots and a screen capture video of the system working, hopefully I will have time to do that today. I've not made any plans this weekend so I'll have lots of spare time then. I'm thinking of joing ATK Natural & Hairy and screen recoding the software working on that site. The problem is, in order to get the software into a state that you could install on your system will take about a week of work\coding\testing. I would like a response from at least 10 PU members before I start proper. Hopefully when I've posted the screen shots\vid I'll get a bit more support\interest. | |
|
||
| 09-13-08 11:02am - 5944 days | #14 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
Hi, I've made 6 videos of the software in action. These are the first videos I've ever made and its taken me a long time. The quality isn't very good but acceptable for a first attempt. I've used KarupsPC for the demo. This next bit is very important. Please note that all the KarupsPC content has been overwritten\masked out with a cross hatch pattern and random dots to protect the copyright. This pattern covers the entire internet browser window apart from a small area around the mouse pointer so that you can atleast see what I'm clicking\doing etc. When I'm showing my browser software all the image content is also party covered, apart from the last video which shows content thats available in the public domain. I'm sure you understand why I've taken these measures to protect other peoples work. I've created a 30 day premium account with rapidshare to host these files, so please do take the time to download them\view them. This is also the first time I've ever uploaded files to the internet, I didn't realise how slow it would be :O I've tried all the videos with windows media player and they work fine, DivX player also works ok, but they dont work with VLC player for some reason, just a blank screen! I would like to apologise now, for my atrocious typing and spelling during the videos (dont laugh). I've got a new keyboard and I keep hitting two keys at the same time and I was very very tired :) Anyway, this is part 1. A short video that shows my (very basic) browser software. http://rapidshare.com/files/144975988/pa...he_basic_browser.avi Video Number 2 This shows how to add zipped photosets into the download manager. I add 6 zipped photosets from Karups. The video is split into part A and part B. Watch them one after the other or join them together. http://rapidshare.com/files/145024277/pa...dd_zips__part_A_.avi http://rapidshare.com/files/145025936/pa...dd_zips__part_B_.avi Video Number 3 This video shows the download manager downloading the 6 zipped photosets. http://rapidshare.com/files/144992378/pa...loading_the_zips.avi I'll post the others when the uploads are done. Edited on Sep 13, 2008, 01:37pm | |
|
||
| 09-13-08 11:32am - 5944 days | #15 | |
|
Monahan (0)
Active User  Posts: 348 Registered: Jan 17, '07 Location: SF Valley, CA |
The full link takes you to an ad for the rapidshare software....http://rapidshare.com/files/144975988/pa...he_basic_browser.avi (the full link ends with /144975988/part_1_-_the_basic_browser.avi) You can see the full link, which is truncated in ByteMaster's post, by doing a REPLY W/QUOTE to his post. Edited on Sep 13, 2008, 11:37am | |
|
||
| 09-13-08 11:40am - 5944 days | #16 | |
|
mr smut (0)
Active User Posts: 107 Registered: Dec 27, '07 Location: Germany |
The link works fine for me but RapidShare is not 100% working at the moment. It took me 15min to start the download. I'm eager to see how the software works :-) | |
|
||
| 09-13-08 11:46am - 5944 days | #17 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
Hi Monahan, if you click the link that will take you to the rapidshare download link. (its a link within a link) I'll describe the screen you should see :- The words RAPIDSHARE at the top in blue\gray with a curved arrow. Then the words EASY FILEHOSTING under in smaller gray letters. Under that you should see two speed dials. Under the left hand speed dial you should see a button named Free User. Click this button and you will be able to download the file. You may have to wait 30/40 seconds for the download to start because you're accessing the free download section. Sorry, I should have explained the link a bit better. | |
|
||
| 09-13-08 01:34pm - 5944 days | #18 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
I've added links (in the post above) for video number 2 and video number 3. Edited on Sep 13, 2008, 01:37pm | |
|
||
| 09-17-08 06:46am - 5940 days | #19 | |
|
asmith12 (0)
Active User Posts: 79 Registered: Oct 17, '07 |
Isn't it even WORSE from safety point of view to put all the data into some database which can be corrupted itself at least just as easily (I don't remember when it was last time filesystem which I worked with got corrupted, but 3rd-party application databases get corrupted on frighteningly regular basis)? And to make it even worse, to put it into some software which is new, untested and can disappear in a few months? Personally I would NOT touch such a thing exactly because of risks of losing of all my precious data, at least not before I make a full backup (but if I have full backup anyway, why would I care about filesystem corruption?). With all due respect to innovation, I would VERY MUCH prefer to have it stored in COMMON formats and be viewable by ANY application; database with indexes/search is fine, as long as it exists "in addition" to these common formats. Motto: "All niches except for boring one!" | |
|
||
| 09-17-08 11:07am - 5940 days | #20 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
Hi, asmith12 I understand your concerns about the way I've decided to store the database. Each ZIP is converted into a PDP file. So whats a PDP file? I take the ZIP, extract all the JPG images. Check each JPG for errors. Create a thumbnail image of each full size image and then place everything back inside a new PDP. Each individual PDP file is like a simple version of the ZIP file format and is stored on disk like any other under FAT32 NTFS whatever file system was used to format the hard drive. The name and storage location of the PDP is decided by the software. The backup manager knows whats already been backed up and what needs to be backed up. But, because everything is stored on the hard drive using the starndard file system then any backup software could be used. Your not tied into using the built in backup tool. Of course the PDP file can be converted back into its original ZIP format at anytime. (recreate a ZIP). The code under the hood has been tested. I've been using it most days for years now. The browser, download manager, backup manager are very robust. My own collection has cost a lot of money to build up so yes, its robust. I spent a lot of time designing the file formats. Because I intend to release this as free software I would have to include the source code. So the system wont suddenly disappear. When I first started this thread I thought the idea of a single application that included a browser, download manager and backup engine specifically designed for porn by a porn collector would be of interest to a lot of PU members, but it seems theres not much interest. This is the first time I've ever tried to release any of my work as freeware and on top of that into a community that is maybe suspicious of new members, I fully understand that and if I was reading a similar thread created by somebody else asking me to risk my collection I would also have the same doubts. However, I wont let this deter me and I will continue with this thread. I've taken the vidoes down for now and will post an update in a few weeks. If you're interested in my system then post comments and I will read them and take them onboard. | |
|
||
| 09-17-08 02:57pm - 5940 days | #21 | |
|
badandy400 (0)
Active User Posts: 869 Registered: Mar 02, '08 Location: ohio |
I think it sounds like an interesting idea. i personally would not mind trying it our for a while using a couple of extra drives and copied data. "For example, badandy400 has taken it upon himself to become the one man Library of Congress for porn with a collection that surely will be in Guinness Book of World Records some day." ~Toadsith~ PU Interview | |
|
||
| 09-17-08 03:00pm - 5940 days | #22 | |
|
badandy400 (0)
Active User Posts: 869 Registered: Mar 02, '08 Location: ohio |
Your links are not working for me. It says the uploader has removed the file. "For example, badandy400 has taken it upon himself to become the one man Library of Congress for porn with a collection that surely will be in Guinness Book of World Records some day." ~Toadsith~ PU Interview | |
|
||
| 09-17-08 03:07pm - 5940 days | #23 | |
|
ByteMaster (0)
Active User Posts: 52 Registered: Jun 09, '08 Location: United Kingdom |
I've taken the videos down for now. They were first attempts and not very good. Yes, You could run the system along side your existing collection and it wont interfere with anything. | |
|
||
| 1-23 of 23 Posts | Page 1 |
| Thread Nav : Refresh Page | First Post | Last Post | Porn Forum Home |
|
