r/ipfs • u/ttocslliw • Apr 28 '20
r/ipfs • u/Swedneck • Sep 17 '18
Cloudflare now has a public IPFS gateway!
r/ipfs • u/jkarni • Mar 12 '19
Radicle: A decentralized alternative to GitHub built on IPFS
r/ipfs • u/sharipova • Jan 09 '20
Anytype.io - a neat UX for IPFS to bring it to non-techies
r/ipfs • u/skogard • Jul 19 '21
I created a system for using IPFS without the IPFS network.
Hi guys, today I am releasing an open source project that lets you use IPFS privately and offline, and only publish later if you want, selectively.
Basically it computes the CID locally and creates a tree of symbolic links that lets you maintain files like IPFS but WITHOUT publishing everything to the public IPFS network.
There are many cases where you want to use IPFS but don't want to immediately publish and keep things private. For example, you may use this for blockchain timestamping without revealing contents, building "Mystery drop" NFTs, and more.
Check it out:
Website: https://nebulus.dev
Tweet explanation thread: https://twitter.com/skogard/status/1417140271637311491?s=20
r/ipfs • u/[deleted] • Oct 20 '20
Filecoin Isn't An Incentivization Network For IPFS, It's A Completely Different IPFS Network
r/ipfs • u/BraveNewCurrency • Apr 28 '19
The Myths of IPFS
We regularly get posts from people who are confused about how IPFS works. People get the idea that "putting something into IPFS" will magically cause the Internet to host their files forever more.
I see the IPFS home page stopped using the phrase "permanent web", which is great. But I think the home page should explicitly address this myth.
I propose that the section "Here's how IPFS works" could clarify things by addressing "How do files get into IPFS?" and "Where are files actually stored?"
The home page also doesn't mention IPFS features to handle popular files. (i.e. creating more duplicates when files get popular. That is still a feature, right?)
Also: The statement "IPFS removes duplications across the network" is unclear to me. As I understand it, IPFS will prevent storing duplicate files on a single node (i.e. you never store the same file twice, even if it's referenced by different pins). But if N nodes all pin the same file, there will be N copies across network, correct? Therefore, it doesn't seem like IPFS is "removing duplicates across the network", but only on single nodes? (Maybe this statement is referring to IPFS clustering?)
r/ipfs • u/marcocastignoli • Jul 15 '20
Hey guys I'm Marco, founder of Nile, a decentralised (based on IPFS, no blockchains involved) and commission-free shopping platform to empower local economies. I'm proud to announce that we are launching it in our city with the support of the local government! github.com/nileorg/nile-client-lite
r/ipfs • u/Imaginary-Age8698 • Jul 08 '26
Ipfs seeing a Huge drop in user base? What happened?
I think this might have been related to NFTs, but Its still sad to see such a powerful technology die off so suddenly
r/ipfs • u/iphone6sthrowaway • Sep 24 '17
Note: IPFS gateway blocked in Spain
A bit off topic, since it’s only the gateway AFAIK, real IPFS should still work.
The IPFS gateway (gateway.ipfs.io) has been blocked in Spain by a judicial order. Reason being that it was being used by the Catalan president (@KRLS) to advertise the Catalan independence referendum which is considered illegal.
So if anyone is wondering what is going on with the gateway not working from Spain, that is what is going on.
r/ipfs • u/koalalorenzo • Jan 19 '19
[New Release] 🎉 IPFS all-in-one desktop client: Orion v1.0 🎉
r/ipfs • u/medicince • Mar 02 '21
IPFS HTTP Gateways ranked by performance
More details here: https://github.com/maxim-saplin/ipfs_gateway_research/blob/main/README.md
A few takeaways
Cloudflare's gateways (cf-ipfs.com, cloudflare-ipfs.com, ipfs.cf-ipfs.com) seem to be the easiest choice and show stable and high throughput, though they do not return content-length HTTP header which makes it impossible to see download progress or pause/resume long downloads. There're questions in CF's community forum about that - no answers why there's no header.
gateway.ipfs.io, 10.via0.com, gateway.pinata.cloud, ipfs.io are also good choice and return content-length .
There're many garbage gateways that show poor performance and are prone to fails.
Files above 20MB significantly grow failure rate.
Accessing the gateways from Ireland and Belarus shuffles the list (e.g. Pinata is ranked 11th in Belarus compared to 5th in table below) - more info in XLS in repo.
Gateways are accessed with CID put in path: https://{gatways-address}/ipfs/{CID}. Some gateways do a redirect converting CID to Base32 and putting it in subdomain: https://{CID-Base32}.{gatways-address}
Smaller files (8.9MB and 30MB)
* Throughput in MegaBytes per second
** % of total 20 requests (10 per file)
| Avg Throughput (MB/s)* | Min (MB/s) | Max (MB/s) | Avg Latency (ms) | Content-length | % Downloads failed** | |
|---|---|---|---|---|---|---|
| cf-ipfs.com | 15,74 | 10,61 | 22,25 | 150 | No | 0% |
| gateway.ipfs.io | 15,61 | 11,97 | 18,68 | 109 | Yes | 0% |
| cloudflare-ipfs.com | 14,85 | 4,69 | 20,07 | 73 | No | 0% |
| 10.via0.com | 13,30 | 0,12 | 27,69 | 216 | Yes | 0% |
| gateway.pinata.cloud | 11,97 | 2,20 | 18,68 | 246 | Yes | 0% |
| ipfs.cf-ipfs.com | 11,60 | 4,09 | 18,76 | 123 | No | 0% |
| ipfs.io | 8,36 | 2,98 | 13,09 | 148 | Yes | 0% |
| ipfs.sloppyta.co | 7,69 | 3,15 | 11,57 | 239 | Yes | 0% |
| ipfs.best-practice.se | 7,51 | 0,31 | 15,54 | 1091 | Yes | 20% |
| snap1.d.tube | 7,34 | 2,61 | 12,94 | 322 | Yes | 0% |
| ipfs.greyh.at | 7,13 | 2,15 | 11,49 | 471 | Yes | 0% |
| ipfs.drink.cafe | 6,19 | 0,92 | 10,63 | 626 | Yes | 0% |
| ipfs.2read.net | 5,99 | 0,23 | 13,85 | 165 | Yes | 0% |
| robotizing.net | 5,65 | 2,18 | 10,56 | 640 | Yes | 0% |
| dweb.link | 5,64 | 0,06 | 10,44 | 1267 | Yes | 0% |
| ninetailed.ninja | 5,44 | 1,97 | 9,21 | 393 | Yes | 0% |
| ipfs.telos.miami | 4,91 | 0,84 | 8,45 | 1363 | Yes | 0% |
| ipfs.oceanprotocol.com | 4,87 | 2,18 | 7,03 | 334 | Yes | 70% |
| ipfs.fleek.co | 4,74 | 2,07 | 7,68 | 929 | Yes | 0% |
| ipfs.overpi.com | 4,15 | 2,66 | 6,52 | 1162 | Yes | 0% |
| ipfs.infura.io | 2,49 | 0,87 | 9,43 | 1734 | Yes | 0% |
| jacl.tech | 2,38 | 0,81 | 4,85 | 2331 | Yes | 0% |
| ipfs.yt | 1,70 | 0,18 | 7,28 | 4736 | No | 0% |
| ipfs.runfission.com | 0,99 | 0,18 | 3,06 | 6959 | Yes | 0% |
| trusti.id | 0,15 | 0,07 | 0,46 | 1791 | Yes | 5% |
| ipfs.k1ic.com | 0,13 | 0,01 | 0,20 | 3476 | Yes | 20% |
| gateway.ravenland.org | Never connected | |||||
| hardbin.com | Never connected | |||||
| ipfs.jbb.one | Never connected |
Lager files (75.4MB and 415.9MB)
* latency is supposed to be lower since the files are downloaded right after smaller once
** larger files' downloads are more prone to be interrupted, also there was 400 seconds timeout to complete download (slow downloads were interrupted on client sides)
| Avg Throughput (MB/s) | Min (MB/s) | Max (MB/s) | Avg Latency (ms)* | Content-length | % Downloads failed ** | |
|---|---|---|---|---|---|---|
| cloudflare-ipfs.com | 29,66 | 19,26 | 43,11 | 51 | No | 0% |
| cf-ipfs.com | 27,85 | 19,06 | 39,68 | 87 | No | 0% |
| 10.via0.com | 27,79 | 0,08 | 43,12 | 131 | Yes | 10% |
| ipfs.cf-ipfs.com | 20,99 | 5,47 | 41,87 | 120 | No | 0% |
| gateway.ipfs.io | 17,05 | 0,21 | 21,25 | 99 | Yes | 0% |
| ipfs.greyh.at | 14,46 | 5,44 | 19,33 | 459 | Yes | 0% |
| ipfs.drink.cafe | 12,95 | 4,69 | 19,8 | 632 | Yes | 0% |
| ipfs.sloppyta.co | 10,87 | 3,55 | 13,55 | 210 | Yes | 0% |
| ipfs.io | 9,68 | 3,26 | 12,87 | 104 | Yes | 0% |
| snap1.d.tube | 9,22 | 3,37 | 13,88 | 138 | Yes | 0% |
| ipfs.telos.miami | 9,10 | 3,10 | 12,89 | 795 | Yes | 0% |
| robotizing.net | 8,81 | 3,49 | 12,99 | 450 | Yes | 0% |
| ipfs.fleek.co | 8,61 | 2,69 | 13,9 | 919 | Yes | 15% |
| ipfs.oceanprotocol.com | 8,55 | 8,07 | 9,124 | 333 | Yes | 70% |
| ipfs.overpi.com | 7,91 | 3,26 | 11,85 | 1020 | Yes | 0% |
| ipfs.best-practice.se | 6,59 | 0,74 | 20,69 | 1325 | Yes | 35% |
| dweb.link | 6,32 | 0,37 | 10,16 | 2077 | Yes | 0% |
| jacl.tech | 6,12 | 1,31 | 12,79 | 2249 | Yes | 0% |
| ninetailed.ninja | 5,89 | 2,26 | 10,15 | 474 | Yes | 35% |
| ipfs.infura.io | 3,80 | 1,01 | 12,38 | 1756 | Yes | 40% |
| ipfs.yt | 1,75 | 0,61 | 4,766 | 2680 | No | 10% |
| gateway.pinata.cloud | 1,67 | 1,00 | 2,542 | 415 | Yes | 10% |
| ipfs.runfission.com | 1,57 | 0,18 | 3,587 | 5116 | Yes | 15% |
| ipfs.2read.net | 0,19 | 0,15 | 0,749 | 161 | Yes | 55% |
| trusti.id | 0,16 | 0,06 | 0,592 | 2094 | Yes | 50% |
| ipfs.k1ic.com | 0,12 | 0,00 | 0,194 | 2948 | Yes | 60% |
| gateway.ravenland.org | Never connected | |||||
| hardbin.com | Never connected | |||||
| ipfs.jbb.one | Never connected |
r/ipfs • u/NatoBoram • Jun 19 '20
I managed to mirror Ubuntu Archives to IPFS then update from IPFS !
I'm not going to pretend it's rock solid, permanent, or even that you should use it, but I finally managed to update my Ubuntu packages from IPFS! pls try it
/etc/apt/sources.list
deb http://localhost:8080/ipns/QmRzYWabKciZNiRxnyPZGbcY8XWDBkqUwNdjXpsm1q2v7F/ubuntu focal main restricted universe multiverse # IPNS
deb http://localhost:8080/ipns/QmRzYWabKciZNiRxnyPZGbcY8XWDBkqUwNdjXpsm1q2v7F/ubuntu focal-updates main restricted universe multiverse # IPNS
deb http://localhost:8080/ipns/QmRzYWabKciZNiRxnyPZGbcY8XWDBkqUwNdjXpsm1q2v7F/ubuntu focal-backports main restricted universe multiverse # IPNS
deb http://localhost:8080/ipns/QmRzYWabKciZNiRxnyPZGbcY8XWDBkqUwNdjXpsm1q2v7F/ubuntu focal-security main restricted universe multiverse # IPNS
deb http://localhost:8080/ipns/QmRzYWabKciZNiRxnyPZGbcY8XWDBkqUwNdjXpsm1q2v7F/ubuntu focal-proposed main restricted universe multiverse # IPNS[1.31 TiB] ipns://QmRzYWabKciZNiRxnyPZGbcY8XWDBkqUwNdjXpsm1q2v7F
I created the mirror using a Raspberry 4 (4 GB RAM) and a 2 TB HDD.
Updating the mirror using rsync takes about 30 minutes and updating it using IPFS takes about 30 hours. Thus, this mirror updates once per two days, provided I'm not working on it.
More technical details : https://github.com/ipfs/go-ipfs/issues/7373
Sources : https://gitlab.com/NatoBoram/mirrord
You can add this mirror to your MFS to explore it using IPFS Desktop.
ipfs files rm -r /ubuntu
ipfs files cp $(ipfs name resolve QmRzYWabKciZNiRxnyPZGbcY8XWDBkqUwNdjXpsm1q2v7F) /ubuntu
ipfs files stat /ubuntur/ipfs • u/NatoBoram • Jun 03 '18
IPFS on Android
Finally, it works! Now, here's how to do it, and what it costs you.
Cost
Running an IPFS node has a cost. A cost in battery, in storage, and in network. However, how heavy are they for a phone? Let's dig into it.
Network
The first one that should concern you is the network usage. If you don't have a data plan, then you probably turn off your mobile data, so that won't be a problem to you. The problem is if you have your mobile data turned on with an IPFS node open : How much data does it costs?
Less than Reddit and Firefox, but more than Android itself. Obviously, it'll drain more data than chat apps like Discord, but it's the app that I used outside home that used the least amount of data. Now, 113 mb might seems like a lot or nothing depending on your network plan. Just be careful.
If you have worries about your network plans, please give a go to Datally.
Battery
Now, it's no fun if you can open a node in the wild but your battery dies instantly, isn't it?
As you can see, in 4 hours, it only used 1% of my battery. We can say that the impact on battery is meaningless. This should not worry you at all.
Storage
Termux is a heavy app because it contains a whole Linux environment for you to play with. It's an amazing app, but it does take something like 1 GB of storage.
… but Reddit is heavier. Interesting, isn't it? Now, your node's weight will depend on your usage of it, obviously. I used it for 4 days straight, but what did I do with it? I uploaded a few screenshots and one or two video recordings of my screen. Storage-wise, I think it's acceptable. However, of you have problems with your storage, please give a try to Files Go. It's amazing.
But how?
There are a few requirements before we dig in. First, obviously, you need an Android phone. Arbitrary code execution is not allowed on iOS per App Store policy.
Everything is installed? Now's the fun part. Personally, I am going to show you how to install Go and compile IPFS-Update even if they are not necessary because maybe, one day, they will provide Android binaries. For now, they don't. So, fire up Termux, and let's have some fun.
First, you want to update Termux to its latest version. Not necessary, but why not?
apt update
apt full-upgrade -y --auto-remove Then, you need to install the necessary programs via APT.
apt install -y golang git wget Now let's compile IPFS-Update.
go get -u -v -fix github.com/ipfs/ipfs-update Then, you want to add go/bin to your profile.
nano .profile The line you are going to add is the following :
export PATH="$PATH:$HOME/go/bin" To quit nano, Volume Down is your CTRL. So, press Volume Down + X.
To apply the changes to your .profile, use the following command :
source .profile Now, ipfs-update is a command that you should be able to run! However, right now, the IPFS devs don't want to distribute Android binaries so you'll have to download the Linux arm binary and put it in your go/bin.
wget https://dist.ipfs.io/go-ipfs/v0.4.15/go-ipfs_v0.4.15_linux-arm.tar.gz
tar -zxf go-ipfs_v0.4.15_linux-arm.tar.gz
mv go-ipfs/ipfs go/bin
rm -rf go-ipfs go-ipfs_v0.4.15_linux-arm.tar.gzWith this, you should be able to run IPFS!
ipfs init
ipfs daemonThere should be a few errors every time you run it, but hey, it actually works!
Congratulations! You now have IPFS on Android!
Now go to Firefox, open the Web UI and upload some files. Or just visit the IPFS links in this post with Firefox and the redirection should work.
Here's a magnificent background, you deserved it : alpha-sunrise-2000x1682.png
r/ipfs • u/bat-chriscat • Oct 10 '19
IPFS in Brave: "Since 2018 we’ve been working with Brave on IPFS support in some form, and the results of that work are now emerging" —IPFS team. Plus, video interview w/ Brave team member!
r/ipfs • u/makeworld • Feb 04 '18
Firefox 59 will support IPFS and others natively!
r/ipfs • u/Haugtussa • Sep 29 '17
How the Catalan government uses IPFS to sidestep Spain's legal block
la3.orgr/ipfs • u/[deleted] • Apr 04 '17
List of IPFS websites
List of ipfs websites or something similar like content, found in swarm or other way... Please do not add simple files, just really websites or folders...
public links:
Local gateway links:
Full websites, with complete design:
ipfs.io /ipfs/ cos its ipfs link, it would be NOT updated
Blog With Love From Snow /ipfs/
Webapps
Video Player /ipfs/ // add hash to video in box (even it works?)
QR code render /ipfs/ // renders from text
IPFSBIN - ipfs pastebin /ipfs/ // but seems not working
Multimedia:
32c3 recordings /ipfs/ also available on media.ccc.de // tons of videos and mp3
chaosradio /ipfs/ also available on ftp.ccc.de // tons of radio records
Movie - The Big Lebowski /ipfs/
Movie - The Dark Knight Rises 2012 /ipfs/
Anime - Ghost In The Shell - Stand Alone Complex S01
Anime - Touhou Gensou Mangekyou S01E01-05
Other stuff:
atari 2600 + ipfs (javatari) /ipfs/
Stanford Seminar - Juan Benet of Protocol Labs /ipfs/
Junk: // maybe some1 will find something usefull here
Movie - Metropolis 1927 1080p - 2010 restored version /ipfs // seems dead
Anime Girls (usually) pics /ipfs/
pictures /ipfs/ // lot of them seems to be without seeder
memes, pictures /ipfs/ // lot of them seems to be without seeder
Sonic Augmentation - music /ipfs // seems to be dead
few random clips /ipfs/ // seems to be dead
jetsetrad.io dump /ipfs/ // seems dead
Amiga Music Collection /ipfs/ // seems dead
christmas music /ipfs/ // seems dead
This list would be edited once here will be listed more hashes for pages, or i just find one more...
r/ipfs • u/sharipova • Mar 11 '21
🧨 Here's a first look at Anytype on Android - demo of an all-in-one tool on IPFS
r/ipfs • u/[deleted] • Feb 13 '20
Privacy first, open source collaboration platform - built on IPFS - demo
DTube: a decentralized video platform using STEEM and IPFS
Dear Reddit community,
This is a repost of the original article, with proper reddit syntax.
I am really excited to finally bring this project to the public. Introducing...
What is DTube?
DTube is an application fully written in javascript, that runs in the browser, that allows you to upload and watch videos on top of the IPFS Network. Moreover, it uses STEEM as a database and enables earning rewards from your uploads.
This might ring a bell for those who remember the SteemQ project announcement, which made almost five thousand dollars in rewards, but never got released and ended up being rebranded - It's still not functional after more than a year, and even the current alpha uses a back-end server for everything and is therefore still centralized. I am sure I wasn't the only person disappointed by SteemQ.
I opted for a different approach. Build something first - talk after. If you are wondering, I did everything by myself (and the help of open source libraries of course) and it took about 4 months to reach what I have now, starting from scratch.
A huge part of this article will be technical and maybe not so interesting to some people, but I believe a big part of my followers are interested in this kind of discussions, so I will explain how it works. Sorry for the incoming walls of text :)
How to use DTube
Logging in
Enter your STEEM username
Enter your Private Posting Key, you can find it like so: https://steemitimages.com/0x0/https://i.imgur.com/8J2kR8j.png
Multi-user login
https://ipfs.io/ipfs/QmRK25KS3chQAaWCvRPexAwdZg1YgxgGLCkjEGLHoaWuqZ
Youtube and Facebook have this amazing feature that you can easily have multiple channels linked to your account and switch between them easily. I am sure I am not the only user on STEEM who owns multiple accounts, and having to use different browsers or bots to upvote with all accounts gets boring very quickly. On DTube, you can log in with as many accounts as you want, and switch between them.
I don't know why SteemIt still doesn't have this feature.
Settings
https://ipfs.io/ipfs/QmdvS4aVNLvUmdQ5hCo52sGxADbothYMNvfhMsQCwj9B96
DTube features a settings menu accessible from anywhere in the app. It allows you to adjust your voting power, filter NSFW contents similarly to SteemIt.com, and tune the IPFS Settings. IPFS Gateway is where the files are loaded from, while the API is what we use for uploading.
Uploading
https://ipfs.io/ipfs/QmStJpYjxKdBTK5fkdW1zmZ2qfpJ8njihpcFKD6wVetUAb
First, you need to be logged-in to be able to access the upload page. Then just simply add a video, a snap (aka thumbnail), and finally fill the texts for the blockchain and submit!
If all goes well, you should be taken to your video after submitting and it should start playing the video between 0 and 30 seconds depending on the gateway and your connection speed.
Browsing Videos
There are currently 3 main ways to discover contents on DTube. You can go to the homepage and discover the NEW , HOT and TRENDING categories. They work the same as SteemIt. You can access a certain user's channel by going directly to https://dtube.video/c/curator for my testing account for example. Finally, you can use the search in the top bar, more information on that later in the article.
How DTube works
Using the STEEM Blockchain as a database
Because we want <strong>DTube to be truly decentralized</strong>, we cannot have a server running a database and use it to query things. Using a blockchain is a natural solution. STEEM has many advantages over other blockchains. It is fast (3 sec blocks). It is free, anyone can use it without having to deposit some form of currency, and transactions have no fees. Who would want to pay money to upload a video, comment a video, or even upvote? Nobody. As an added bonus, the STEEM blockchain already has a reward-earning mechanism.
Any video uploaded on DTube becomes a STEEM content, that can earn rewards for 7 days. DTube doesn't use either the title or the body of a content to store information, therefore if you don't want your video upload to appear in your feed, you can edit or delete it, the video would stay intact on DTube. While it would be possible to display nothing on other platforms like steemit.com or busy.org, I believe the current behavior to be fine and will help the platform growth and the users rewards.
Using IPFS as a static file storage
IPFS is a protocol that enables decentralized file storage. The principle behind it is called Distributed Hash Tables (DHT). The same principle also powers the BitTorrent network. Just like how cryptocurrency uses asymmetrical cryptography, DHT networks will hash contents in order to be able to identify a file. The hash becomes the identifier of a file, and it's as easy as re-hashing a file and making sure the hashes match to ensure the file that was sent to us is the original.
Why not use Torrent then? Torrent arguably already has more content and is more mainstream. However, Torrent was not built for the web. Some implementations such as <a href='https://webtorrent.io'>WebTorrent</a> are trying to make it work, but it still requires some 'hybrid' clients that would act as bridges in order to transfer files from hard clients such as μTorrent to web clients that run in a browser. Not very convenient, even less efficient. I am sure a lot of you have used <a href='https://github.com/popcorn-official/popcorn-desktop'>PopcornTime</a> to watch some 'pirated' content and have enjoyed it, but building something similar that runs inside a browser without having to run hybrid clients to connect people, is sadly impossible.
IPFS is a younger, open-source, and actively developed protocol. It has a bright future ahead. Using it as the main mean of storage for this project was a no-brainer.
IPFS Storage Cost
IPFS is cool, but there is no magic. Someone needs to seed the files, and your browser cannot permanently store huge files (local storage is limited to 50MB on most browsers), so seeding through the app directly is not possible as of today. While my first idea was to ask some witnesses to run some IPFS nodes, it became clear after a few conversations that this would create more problems than solutions as most witnesses are non-technical persons and running and configuring an IPFS node correctly seems to be a tough challenge for most. I still believe this solution to be the right one, but I would clearly need to setup a docker or something easy for witnesses to actively join the DTube network and start seeding files (and earn a share of the rewards).
Instead, I searched for existing IPFS nodes and contacted the owner of IPFS Store, a website that allows you to pay in Bitcoin to keep your files on the IPFS network. After a few positive and instructional replies from @nannal (steem, twitter/etc), I knew I found my man.
I have recently created the @dtube account. This account will be used to collect 25% of the DTube author rewards. 10% of these fees will be used to pay for long-term storage of the files on IPFS Store. The rate is $0.044 per GB per month. So, for example, let's say you upload a 100MB video, that earns $10 rewards, then $0.25 will go to @nannal and ensure data redundancy for ~57 months. Once this time is passed, users will need to either pay themselves (crypto accepted of course) to keep the files being seeded, or seed it themselves directly on their own PC and connection.
Design
Most developers know the saying 'do not reinvent the wheel'. The same applies to design and user experience. The leading video platform YouTube has been running successfully for years, and copying them makes sense. Especially when I am a sucker at front-end development and UI design. I tried to copy the look and feel of YouTube using the Semantic UI framework. While I am proud of what it looks like, I am sure some more talented people than me would slap me in the face for how bad it looks and plays.
I am very open to suggestions. Or if you are a web-designer, with a good portfolio, and Semantic UI experience, feel free to contact me on the steemit.chat.
Using AskSteem for Search
It might be hard for non-technical people to understand it, but the search is actually the toughest problem to make DTube a viable product. When you have a standard SQL or Mongo database, searching is easy. However here, our database is the STEEM blockchain, and we cannot search by communicating with a steem node directly. I understand that search is a low-priority feature for a blogging platform, especially when Google indexes every content and offers a search API. But for DTube, users will use it a lot.
I contacted @thekyle, a competent developer who posts on SteemIt but doesn't get half as much rewards as he deserves. He recently introduced AskSteem, a search engine for the STEEM blockchain. His service uses an ElasticSearch DB and will index new videos under 15 minutes.
His API was originally not enough for me to display certain information such as the video snap (thumbnail) in the search results, or else I would have needed to make one call for each search result, i.e. a lot of useless calls. @thekyle fulfilled my request to improve his API in under 24 hours, and allowed it to run smoothly as it should. ❤
Arguably, the search is not decentralized. Any search will go through the AskSteem server, search results could be altered, or the search could just stop working if @thekyle decides to close it.
A better solution would be to have a search function directly on the steem nodes. Another solution would be to have yet-another DHT network running inside the app, with a fuzzy search function. I have literally no idea if making a fuzzy search algorithm on a DHT network is possible without creating a point of failure, and I don't think anyone has an answer to this question on Earth. That's why I decided to make a compromise. We will see how it goes.
Permanently stored data
DTube will use your browser local storage to store a bit of information. First, it will store your user accounts and posting keys so that you don't have to relog every time. I suppose that won't shock anyone considering steemit.com does the same.
Secondly, DTube also stores your watched videos in order to display the 'Watch Again' category. Just like YouTube does it. You can notice that post rewards won't show for the Watch Again category, as these rewards can change at any point in time and it would be impossible to trust the data we stored a while back ago.
If you clean your browser sometimes, you will have to relog and your watched videos history will be cleaned, with no way to get them back. Just a friendly warning :)
Why can't I log in with my master password or active key?
Because it's a retarded thing to do. Steemit.com allows it solely because they also have a wallet in the app. XSS attacks are common on the internet, and most devs are rightfully paranoid about it. I would feel terrible if some users of my app lost their accounts and money because of me. Instead, it is much easier to force users to use the posting key and limit the risks.
DTube does not include any feature that requires anything else than the posting key. That means no wallet, no password reset, no internal market trading, no powering down, and way less work for me. If you want to manage your STEEM rewards, I invite you to use Vessel. And only use your posting key on any online platform such as steemit.com, busy.org, etc.
"What about SteemConnect??" I can see this as a comment below this article already. I am very aware of the SteemConnect project, that aims to provide an easy way for developers to enable STEEM login and key management. However, I am personally very much against delegating my keys or sending them to someone else to use, even if it's a trusted 3rd party ran officially by SteemIt Corp. Sorry but I like to remain in 100% control of my keys, and you should too. Remember all the people who cried on Reddit whenever an exchange got hacked? Don't be like them.
The case for user-side encoding
On YouTube, you upload your original file, and YouTube will encode your file and even convert it to multiple qualities, as well as create some fancy gif to preview the video on mouse hovering.
Achieving the same in DTube is hard. Encoding a video file in javascript is harder to code, and would always be slower. Bad On top of that, if you want multiple quality files, then you would need to upload multiple files and multiply the time it takes to upload your video. Bad Bad Finally, it would probably grow the total size of the DTube application quite a bit, and therefore increase the initial loading time. Bad Bad Bad
There are already countless programs that permit video encoding. And that would only be required to do for videos recorded with professional tools such as high-grade cameras. People who own this kind of hardware, usually already know about encoding. My personal smartphone already encodes every video in H.264, and I suppose your iPhone does the same. So why not keep it stupidly simple?
Easy to integrate for other platforms
Any other STEEM based platform can easily integrate videos posted on DTube. The video IPFS hash is stored inside the json_metadata of a post. Then it is as easy as doing <video src='https://ipfs.io/ipfs/videohash'></video>
Known Issues
No progress bar on the upload - github issue
Avatars don't resize and load the full-size images - maybe solution
Missing features
Reputation system
Tags browsing
Video suggestions (on the right of the video)
Following Channels
Custom Player
I believe the current state of the product to be viable, even without these missing features. I will add them, slowly. Also because I am unsure which of those is a priority right now, I will let you guys choose and argue about it in the comments!
App Dependencies
DTube is built with Meteor, and uses many open-source packages from NPM. DTube wouldn't exist without them, so they deserve some credits.
ipfs-api - Communication with the IPFS Network
SteemJS - Communicating with the STEEM Blockchain
autolinker - Adding links to descriptions / comments
moment - Displaying times
XSS - For displaying untrusted texts and preventing XSS attacks
Credits to debuggers and idea suggesters
@steeminator3000 @dailydogger @coldbolt @nannal @thekyle @ekitcho @fabien @kalvas @french.fyde @nnnhhh @fayetristan @lukestokes
Cross-links
Last words
While I personally believe that decentralization is the future, don't get your hopes too high yet. Competing with YouTube is an heavy task that cannot be done by one man. My intent with this project was to practically demonstrate the possibility of decentralized video on top of IPFS. It works, but we don't know how well it will work in the long-term. YouTube also has a lot of extra features that makes the experience superior. What I built, represents maybe 1% of the work required to have something that can compete with YouTube. I built some walls, but there is no insulation, or painting, and the whole building might collapse at any time.