[Release] OfflineBay v2 - Open source and No more Java dependency

[techtac]

I firmly believe TPB is the greatest thing since Roman aqueducts and I fully support them

Haha. Couldn't agree more. 

[urbanguac]

Hello! I can't believe I stumbled upon this only now!

I put the Pirate Bay dump on ipfsearch, a decentralized search engine and have some questions about how OfflineBay works.

How do you use DHT to get seed/leech counts? I thought that there is close to no way to finding this out accurately and fast, and for generating my index, I use the trackers that Pirate Bay includes by default in their magnet links. Without being in the DHT swarm for long, you can pretty quickly (quickly by distributed systems standards, slowly compared to trackers ) find one peer with the files, but not the definitive peer count.

Do you use the NoSQL database only for metadata and not for indexing the dump? From skimming through the code, it seems that it's sequentially reading the whole CSV file (or something CSV that you're parsing) and searching for the wanted words, but I am absolutely unsure, the code is pretty hard to read...

Where can I find the code that handles the tokenization? I have no control over the tokenization on the querying side -- there is the Porter Stemmer, but I'd like to see how have you handled all the edge cases about torrent naming like (h264), dots instead of spaces, etc.

How do you feel about the rewrite to JS now? ipfsearch has a library for index generation that is written in Typescript (typed JS). Now that I look on the code I have written for index generation, it would've been faster to just write my own library for index generation for ipfsearch in something what supports threading, is much more elegant and has runtime type checks, like Go (I love Go! and Java is ok too). Would you tell younger you to rewrite it to Javascript?

Now I'm looking back at this it seems like there are a lot of questions ... I'd be super happy if you could answer all this, thanks in advance!

If you want to check out the Pirate Bay dump: https://ipfsearch.xyz/?index=/ipns/12D3K...XpKteg2zMx
If you want to read more about ipfsearch: https://ipfsearch.xyz/

P.S.: I'm not the developer behind ipfsearch.xyz, I only created the index. Yes, code for generating the index is not open source yet, but it sure will, one day! ipfsearch.xyz is open source.

[Moe]

I thought that there is close to no way to finding this out accurately and fast

There isn't, and there never will be.

[ejonessss]

anyone know of any mirrors where i can get database dumps for offlinebay?

[waregim]

Spasibo.

A wonderful program, understandably a bit rought around the edges, that I am happy to have, and hoped would never need.

Times change.

Is there any advantages to compiling this in Node? Have it on the system....

[oudyn]

i cant find the torrent dump.

[waregim]

http://uj3wazyk5u4hnvtk.onion/static/dum..._2017.html

[CKkio23]

Show Content

Spoiler
As i promised, OfflineBay 2.0 with no Java dependency is here. I took the past few months go on a completely new journey of learning Electron and developing OfflineBay 2.0. Also in the favor of majority i decided to make this project open-source. So no more conspiracies and no more complaints. I hope a lot more developers could get involved in this now since it's written in Javascript. So hop on.... 

PLEASE WATCH THE FOLLOWING VIDEO BEFORE YOU START USING OFFLINEBAY



If you're not familiar with OfflineBay at all, watch this video too. Also you can tune in on the previous conversations on OfflineBay by heading over to this thread.

What's new in OfflineBay 2.0?

• Programming language switched to Javascript (NodeJS) from Java
  
• Functionality stabilized on all platforms
  
• GUI Built on Electron framework (HTML + CSS + Js)
  
• Splash screen
  
• Smoother animations
  
• DB switched to NoSQL (NeDB)
  
• Made Open-source
  
• Gzip dump import support
  
• 85% Faster importing
  
• Drag and Drop importing
  
• Remote dump update support
  
• Auto dump update support
  
• System notifications support
  
• System tray support
  
• 15% Faster searching
  
• Instant search feature
  
• Search autocomplete support
  
• Fixed table sorting
  
• Faster filtering
  
• Faster Seeds/Peers discovery
  
• DHT support for scraping
  
• Customizable tracker fetching URL
  
• Best trackers selection for magnet links
  
• Theming support
  
• Customizable configurations (Preferences window)
  
• Configurations import/export support
  
• Google search button
  
• Windows shortcut helper
  
• Logging to file support
  

Download OfflineBay - Downloads for all platforms (Documentation is available there. Read them before downloading)


 Support OfflineBay (and me)

Involvement as a contributor by adding a few lines of code, fixing a bug, respond to issues, testing etc… would be one of the most helpful methods you could support the project. If you’re not a programmer but a creative person, you could definitely get involved in the GUI part of OfflineBay.
If you have some spare coins laying around, you could throw some this way to buy me a coffee…

• BTC: 12d9qz6bzL6tiB4oeX595oEo9ENMTEzF5y
  
• ETH: 0xe84CBc4B4C64c6800619942172F93dcfb1030972
  
• BCH: qqguu77ylq7p72m02ksv78jyzy86vtk6jqtrrc40r3
  

Since i’m also a video creator on YouTube, you can give me some support by Subscribing to my channel and sharing some of my videos.


 Themes

Since OfflineBay now support themes you can create your own themes and share them with the community. Also you can download any theme from there.

Themes repository (Documentation is available there)

---

A big thanks go to this clueless sucker for the challenge. It was one of the biggest motivations. 



Happy torrenting..

Hello Was wondering how i can create my own CSV database to only have my own personal torrents?
I don't understand where you get the base64 code for the torrents?

[techtac]

Hello Was wondering how i can create my own CSV database to only have my own personal torrents?
I don't understand where you get the base64 code for the torrents?

Just follow the same header structure as the TPB dump. You can check the source code to find how it's done. It's a simple base64 decrypt function.

[ajo000]

Hey, my question I got torrent from this csv dump file , example below :

2019-Apr-13 22:04:04;K4t83wWiKQ4p2S+ZIi49jNrV64I=;"Adobe Media Encoder CC 2018 v22.0.1.64 (x64) + Crack";10596222

and how to decode this "K4t83wWiKQ4p2S+ZIi49jNrV64I=" on magnet url ? I tried to decode via online tools (base 64 decode) .. but I got incorrect result, some chinsese characters, not correct magnet url .. please help, thank you.