Page 1 of 2

Trying something different

Posted: Sun Jun 20, 2010 1:00 am
by BizarreLoveTriangle
Looks like sharing all those 1000s of files is too inefficient, so I implemented a form where people can enter what they need:

http://cloud9.endofinternet.org/flmhash/

Requested files will be added to my shares automatically.

Re: Trying something different

Posted: Sun Jun 20, 2010 2:42 am
by Phuzzy4242
BizarreLoveTriangle wrote:Looks like sharing all those 1000s of files is too inefficient, so I implemented a form where people can enter what they need:

http://cloud9.endofinternet.org/flmhash/

Requested files will be added to my shares automatically.
That's really interesting, BLT, and may be a good way to speed things up for downloaders. Do you remove files from sharing after a set time period? About how many files do you share to keep it efficient? I've got about 375 shared at the moment.

I'd be interested in seeing the code for the entire process.

Re: Trying something different

Posted: Sun Jun 20, 2010 3:58 am
by BizarreLoveTriangle
Phuzzy4242 wrote:Do you remove files from sharing after a set time period?
I guess I will. It is not done automatically yet.
Phuzzy4242 wrote:About how many files do you share to keep it efficient?
I don't know how to measure the "efficiency". I used to share everything except fast downloads with many sources, but the queue was getting very long and apparently it even slowed down my own downloads. Now I removed *all* shares, so I only share what people request.

However, I have lots of incomplete downloads, which I am of course also sharing.
Phuzzy4242 wrote:I'd be interested in seeing the code for the entire process.
Well, it's just a couple of home-brewed Python and Bash scripts :blush

Re: Trying something different

Posted: Sun Jun 20, 2010 6:45 am
by Phuzzy4242
I move almost everything non-FLM out of sharing as soon as it's downloaded and still have around 400 people in queue for around 100 different files on average.

The main drawback I see with your technique is that people won't know about your request system or won't want to make the extra effort. If a film is so rare that you're the only one who has it, most will just request it in a forum, and if it's not rare, they'll get it from other sources and never think to ask you to reshare.

Also, if you're not sharing, you're not accumulating points so your downloads will be slowed since it'll take longer to get to the head of the queues. One of the errors newbies often make is to not share stuff (or not share stuff anyone wants). I know you're not a newbie, just wanted to point that out.

Since I have hard drive space to spare, I don't remove anything from sharing unless it's well sourced (such as Hit Girl) or non-FLM - nobody gets in queue who isn't looking for FLM stuff, at least once those "temporary" files are completed. I used to take a look once a month at what's been downloaded and remove some of the stuff that nobody has requested unless it's a real rarity, but I haven't seen any slowdown in downloading - how do you know yours has been slowed? I think the only way uploading might slow downloading is if you max out the upload bandwidth so downloading doesn't have enough for proper handshaking like ACK/NAK/CRC.

Re: Trying something different

Posted: Sun Jun 20, 2010 8:30 am
by BizarreLoveTriangle
Phuzzy4242 wrote:The main drawback I see with your technique is that people won't know about your request system or won't want to make the extra effort. If a film is so rare that you're the only one who has it, most will just request it in a forum, and if it's not rare, they'll get it from other sources and never think to ask you to reshare.
The system is still highly experimental. I will see if it makes sense or not.
Phuzzy4242 wrote:Also, if you're not sharing, you're not accumulating points so your downloads will be slowed since it'll take longer to get to the head of the queues.
I am still sharing all the incomplete downloads and anything people request. Might add some extra shares if needed.
Phuzzy4242 wrote:Since I have hard drive space to spare, I don't remove anything from sharing unless it's well sourced (such as Hit Girl) or non-FLM - nobody gets in queue who isn't looking for FLM stuff, at least once those "temporary" files are completed. I used to take a look once a month at what's been downloaded and remove some of the stuff that nobody has requested unless it's a real rarity
My client does not leave any logs about what has been downloaded. It is also difficult to find out how well a file is sourced once a download is complete.
Phuzzy4242 wrote:but I haven't seen any slowdown in downloading - how do you know yours has been slowed?
I cannot fully explain that, but my ISP seems to do some weird traffic shaping. It might also be that my client cannot cope with thousands of peers. I noticed that you had the Kacenka movies complete when I was still at <10% :wall I am still downloading those movies, but it goes faster now.

Also experienced users say that it is not good to share too much at a time, but if I unshare a file, how would I know that somebody needs it? Of course members can bump a thread and request a reshare, but I might not notice that if I am not reading the forum regularly.

Re: Trying something different

Posted: Sun Jun 20, 2010 5:40 pm
by BizarreLoveTriangle
If anybody wants me to reshare some (older) FLM releases, but not visit the above link for some reason, feel free to contact me via PM.

(In case some people are worried about privacy -- by running an HTTP server I cannot get any more info about users than I do by running an eMule client; I *don't* use Cookies/Javascript/Flash.)

If I post any links on this board, they are of course initially shared anyway.

Re: Trying something different

Posted: Wed Jun 23, 2010 11:56 am
by Jacen
Thanks! :thumbsup I might give it a try sometime. :)

Re: Trying something different

Posted: Sat Jun 26, 2010 5:00 pm
by BizarreLoveTriangle
I had problems with FLM search, so I set up a new search engine:

http://cloud9.endofinternet.org/flmsearch/

And of course everybody is welcome to try it :)

Index is automatically updated every 6 hours.

Re: Trying something different

Posted: Sat Jun 26, 2010 5:35 pm
by starfish21
this looks quite useful

if anyone wants to make a shortcut for this....

heres a little icon to use


[Image]

or Like this post to see ed2k links  [1.6 KiB]

Re: Trying something different

Posted: Sat Jun 26, 2010 7:32 pm
by FLL
BizarreLoveTriangle wrote:Looks like sharing all those 1000s of files is too inefficient, so I implemented a form where people can enter what they need:

http://cloud9.endofinternet.org/flmhash/
This is useful, I used it myself to finish something I had been waiting on for months. I also put everything I had taken offline and moved in my "Incomplete" folder into it, and while most of it showed you were also ancomplete I did get two more to finish. Those two had gotten sources since I stopped them, so it wasn't just your reshare, but it was still useful to know there were now sources, since enabling all my incompletes to check (which I used to do every couple of months) is a real pain.

Good work! :clap
BizarreLoveTriangle wrote:I had problems with FLM search, so I set up a new search engine:

http://cloud9.endofinternet.org/flmsearch/
This will be interesting... if you know your way around FLM search it actually works, but it has several peculiarities (mandated by the database and webhosting limitations) which makes it hard for people to understand. And since February it is only partially full-text, of course. If you have set up a full-text search which deals well with accented characters, and acts more like a web search engine does, that could be very useful. We will see ;)

Thanks for helping make FLM a better place!