Request: RSS Feed Scanner with details => get translation :)

[rl4engb]

Hi all,

It's not often I'm genuinely impressed with a program but Bit Che is absolutely brilliant! Well done Chip, great work! The icing on the cake for me would be the addition of an RSS feed scanner (I know what you're thinking, use the one in uTorrent or Azureus etc) The problem with these is the success rate of them actually getting a torrent is extremely low because the link within the RSS is not the link to the torrent, only the details page.

Example, this link taken from the torrentspy feed:-

http://www.torrentspy.com/torrent/1176305/20070515_UK_Ch_5_Return_of_the_Tribe_2_of_3

.. but the actual download link is as follows :-

http://cache.torrentspy.com/download.asp?id=1176305

So, using a user-defined regexp or similar, in the same way the torrent site scripts work, If this RSS feed could translate from the "details" link to the "download" link, this would be an extremely powerful, automated addition!

e.g.: (Having to refresh my regexp skills at this point so bear with me! .. ) Something like :-

s/http:\/\/www\.torrentspy\.com\/torrent\/([0-9]+)\/.*/http:\/\/cache\.torrentspy.com\/download\.asp?id=$1/;

i.e., it substitutes the "details" link with the "get" link, extracting the torrent id (hence the () brackets) and generates the "get" link.

I'd gladly help with the conversion scripts if this could be incorporated? It seems this technique is the final missing link to provide full automation, it used to be in place until torrent sites started removing the links to the torrents from the feeds.

Any comments appreciated!?

Cheers,

Rob

[Bovski]

Bit Che doesn't use a Regular Expression Parser and I think this kind of drifts beyond what the program is designed to do.

There is also the problem if you are going to get it to automatically download is that the torrent client will just sit waiting for where you want to save the file.

I already have an app that reads RSS Feeds and parses & Translate info from the pages they link to this may be a good time to re-look at it.

[EDIT]

On reflection and knocking together an app to do this it would be a good addition to the Guevara Edition.

[/EDIT]

[rl4engb]

Hi Bovski,

The automation bit is over and above what Bit Che currently does, but it's not that much different in context: Bit Che essentially provides a link from a user searching for a particular torrent, to the downloading of that torrent (via many search sites). An RSS feed would just be the same, except it would run the users search on a regular basis, and automatically download any results (or perhaps provide a "pick list" for later viewing)?

Also uTorrent wouldn't sit there waiting, as when a .torrent file is opened (or launched) it saves it to the default download directory.

What is this app with an RSS feed scanner/translator you have? Sounds interesting, is it publically available?

Cheers!

[Bovski]

Last things first no it was never publicly available it was for nicking posts from some 400+ sites removing duplicates and adding them to a blog the problem was it used way 2 much bandwidth(it maxed out my 10Mb connection) and the blog filled quicker than it could be read.

Back to the RSS Torrent Thingy (didn't realize utorrent did that I always tell it where to download ya learn something new every day )

Currently only vary basic read RSS Parse download link Add to list

Couldn't get your RegEx to work (My knowledge of RegEx is vary limited) but am working on adding some RegEx Type Matching

Only 3 parse methods supported at the moment

0=Don't Parse
1=Simple Search & Replace
2=Sort of RegEx (Expresion©String)  ©can be typed by holding down ALT and typing 0169 on the numeric keypad
i.e.
Original: s/http:\/\/www\.torrentspy\.com\/torrent\/([0-9]+)\/.*/http:\/\/cache\.torrentspy.com\/download\.asp?id=$1/;
Trans2: http:\/\/www\.torrentspy\.com\/torrent\/([0-9]+)\/.*@http://cache.torrentspy.com/download.asp?id=$1

3 Methods for 3 Sites its early days

give it a test and let me know if it works

http://www.mytempdir.com/1342651

also What needs doing apart from
1) a proper scripting parser I'm already working on it
2) Automatically Downloading Torrents(calling client)

[Edit]
P.S.
you can add scripts if needed though User,Pass & Records arn't implemented yet(& Probably wont be)

Item,Title,Link,Description,Category,Comments,Date,Poster need to match the fields in the feed
[/Edit]

[rl4engb]

Hi Bovski,

Downloaded it, ran it, works brilliantly! Excellent many thanks, I'm gonna go and create more .ini's for some existing RSS feeds, but this is really is the sort of thing I was looking for. I take it when it refreshes from the RSS feeds it just keeps adding to the list, so I can look at it after a day at work and scroll through all the previous days entries?

I think an option (per-search), of whether it should download it or just add it to some sort of picklist would be great. E.g supposing I did a search for "modern.*marvels.*engineering.*disaster.*", I might not want it to download straight away as I may already have it, but if it flagged it up somehow, then I just scroll through the list and cherry pick what I want.

Once again many thanks it works great, let me know if you need any help with regexp's or the scripts or whatever I'll see what I can do.

Cheers,

Rob

[rl4engb]

Had a quick play, very powerful, for some reason I get an error when trying to add the isohunt RSS feed, I think it's something within the RSS but anyway, here's some scripts for people to play with.

Really does provide a quick way of getting the torrents you need! No annoying popups or flash adverts that slow your browsing down.

Have fun,

[Bovski]

the isohunt problem is down to the fact it didn't like the user agent string

I'm Still Miles off getting it all working properly but its sort of Getting there

You mentioned some automation I have been looking into that and didn't really the RegEx as its to complicated for the average user



The Folder option is there so torrents can be downloaded into there correct folders. Well not the torrents but the files the torrents download.

the RegEx at the bottom is just there for debugging though you will probably notice 20 is missing that's down to the fact that it appeared in a feed and is now downloading. When all the items have downloaded in this case episodes the task will be removed.

[rl4engb]

Looks good, yep regexps are a bit arcane but when you get to know them they are great, useful for filtering out stuff you don't want. Let me know when the update is available and I'll download it and have a play.

Cheers

Rob

[Bovski]

Well I just wanted to simplify the auto downloading so replaced things like (" "|"\."|"-") with "."
eventually most people will only use it on there favourite sites like Chronic or DidiDave where there
isn't fake content.

It's a fairly pointless app for searching lots of public sites as the first copies to appear are normally fake
hence why I haven't bothered to do a Multi-threaded Scan.

Normally i try to avoid the registry as some of the more paranoid users wonder what you are doing there
the only key this will read is.
"HKEY_LOCAL_MACHINE\SOFTWARE\Classes\Applications\uTorrent.exe\shell\open\command"
and you can avoid that by putting the path to uTorrent in the RSSTorrent.ini .

[rl4engb]

OK great work I'll have a play with the new one.

Cheers,

Rob

[UltrA1]

Love the add rss feeds idea,... Love bit-Che too.. keep it up )


Now only if i could add or hide public/private feeds/scripts/keys that would be nice..

Wish you Happy Holidays!!