Commit Graph

1689 Commits

Author SHA1 Message Date
tleydxdy f02ac01f7e
Add exponential backoff to refresh_channels
In practice with the patch I usually see backoff to 2 hours when blocked, so it should improve recovery time. The lim_thread is to work with multi-threading, not sure if it's the best way to do it.
2020-09-09 11:47:11 -04:00
Ben Heller 4a6e920d0e
Use new youtube API to fetch channel videos (#1355)
* Use new API to fetch videos from channels

This mirrors the process used by subscriptions.gir.st. The old API is
tried first, and if it fails then the new one is used.

* Use the new API whenever getting videos from a channel

I created the get_channel_videos_response function because now instead
of just getting a single url, there are extra steps involved in getting
the API response for channel videos, and these steps don't need to be
repeated throughout the code.

The only remaining exception is the bypass_captcha function, which still
only makes a request to the old API. I don't know whether this code
needs to be updated to use the new API for captcha bypassing to work
correctly.

* Correctly determine video length with new api

* Remove unnecessary line
2020-09-02 20:28:57 +00:00
stranger195 13f58d602f
Replace omarroth with iv-org where applicable (#1353)
Fixes #1353
2020-08-25 16:07:16 +00:00
Omar Roth 62f015fc34
Fix playlist export for playlists with more than 100 videos 2020-07-28 17:21:39 -04:00
Omar Roth 176ef19cca
Update mixes link 2020-07-26 11:50:26 -04:00
Omar Roth db83ede73c
Add missing default for ConfigPreferences 2020-07-26 11:09:45 -04:00
Omar Roth 452d1e8307
Fix warnings with latest version of Crystal 2020-07-26 10:59:31 -04:00
Omar Roth 92f337c67e
Add playlist import/export 2020-07-26 10:59:31 -04:00
Omar Roth 1e4022680a
Fix playlists with one video 2020-07-26 10:59:31 -04:00
Omar Roth b5f79444f9
Fix optional value in data extractor 2020-07-21 20:11:13 -04:00
Omar Roth 8ed1c77e47
Skip DASH streams segmented by URL 2020-07-04 14:17:46 -04:00
Omar Roth 8c65b8c16f
Update playlists to support polymer redesign 2020-06-24 22:19:36 -04:00
Omar Roth 1f435522b4
Fix cast from nil in short_description 2020-06-17 19:22:28 -04:00
Omar Roth 83b1d80a5b
Fix signature URL regex 2020-06-16 19:21:29 -05:00
Omar Roth 38c7dda00f
Fix genreUrl 2020-06-16 17:51:49 -05:00
Omar Roth 056e7432bd
Update channel playlists to use polymer 2020-06-16 17:51:35 -05:00
Omar Roth 1eca969cf6
Add support for polymer redesign 2020-06-15 18:18:04 -05:00
Omar Roth c1cbdae5ee
Make HOST_URL constant 2020-06-15 18:13:14 -05:00
Omar Roth 4d4b6a2fa0
Remove top page 2020-06-15 18:11:36 -05:00
Omar Roth d30a972a90
Support Crystal 0.35.0 2020-06-15 18:11:06 -05:00
Dmitry Sandalov 338dc3223c
Merge pull request #1182 from DmitrySandalov/master
Allow user to subscribe to playlist (#17)
2020-06-13 15:10:18 +03:00
Omar Roth 6435c7b921
Fix reCaptcha 2020-05-28 12:21:47 -05:00
mendel5 80941eacbd
More consistent HTML IDs for info section (#1156)
* More consistent IDs for info section

More consistent IDs for info section: watch-on-youtube, annotations and download

* Consistent IDs: channel-name

* Consistent IDs: published-date

The term "published" can also be found in the answer for the following YouTube API request: https://developers.google.com/youtube/v3/docs/videos/list
2020-05-26 02:57:10 -05:00
Omar Roth ceb252986e
Update captcha job 2020-05-25 12:52:15 -05:00
Dmitry Sandalov 5d8de5fde2
Allow user to subscribe to playlist (#17) 2020-05-17 14:28:00 +03:00
Omar Roth 750ef296c6
Update captcha handler 2020-05-13 16:09:39 -05:00
Omar Roth 454ae8656a
Cleanup request headers 2020-05-08 09:00:53 -05:00
Omar Roth 75450dcdbc
Update signature param 2020-05-08 08:59:09 -05:00
mendel5 9d23cf33fd
Consistent IDs for info section (#1133) 2020-04-30 15:01:29 -05:00
Omar Roth 97eb01a28d
Merge weblate 2020-04-20 16:46:00 -05:00
Omar Roth 408f3852ec
Hide playlist widget when user has no playlists 2020-04-15 16:30:02 -05:00
Omar Roth 7bb7003c9d
Fix authorThumbnails in /api/v1/channels 2020-04-10 11:49:51 -05:00
Omar Roth 920463f2ff
Fix playlist_ajax 2020-04-10 11:49:18 -05:00
Omar Roth ca1185d0be
Fix warnings in latest version of Crystal 2020-04-09 12:18:09 -05:00
Omar Roth 02d4186b11
Fix player matching 2020-04-09 10:55:50 -05:00
Omar Roth 3f97bebd69
Support adding video to playlist from watch page 2020-04-09 10:55:32 -05:00
Omar Roth 2e378da922
Add support for Swedish locale 2020-04-04 15:57:29 -05:00
Omar Roth b37f51bd7f
Fix /c/ redirect 2020-04-04 15:31:24 -05:00
Omar Roth c97cdf551e
Refactor extract_plid 2020-03-30 14:27:07 -05:00
Omar Roth 3b2e142542
Fix JSON serialization 2020-03-29 18:04:44 -04:00
Omar Roth 92798abb5d Add manifest-src to CSP 2020-03-19 13:41:08 -05:00
Omar Roth 59a15ceef6
Remove VarInt class 2020-03-15 17:47:16 -04:00
Omar Roth 4011a113cc
Strip invalid characters from referer URLs 2020-03-15 17:47:16 -04:00
leonklingele 70cbe91776
Migrate to a good Content Security Policy (#1023)
So attacks such as XSS (see [0]) will no longer be of an issue.

[0]: https://github.com/omarroth/invidious/issues/1022
2020-03-15 16:46:08 -05:00
Omar Roth f92027c44b
Escape 'sort_by' 2020-03-10 11:25:32 -04:00
Omar Roth 1443335315
Switch textcaptcha to HTTPS 2020-03-10 11:12:11 -04:00
Omar Roth bb72672dd9
Replace static asset requests with QUIC 2020-03-06 13:53:35 -05:00
Omar Roth d96dee3aa6
Add debug info to videoplayback 2020-03-06 13:50:00 -05:00
Omar Roth bd0aaa343b
Prevent storyboards from hanging 2020-03-05 13:49:06 -05:00
Omar Roth a117d87f33
Skip validation checks for videoplayback, ggpht 2020-03-04 13:06:17 -05:00
Omar Roth 9dc4f8a1aa
Escape item titles in search page 2020-03-04 13:03:14 -05:00
leonklingele 0d536d11e3
Verify token signature in constant time, Run cheap checks first in token validation process (#1032)
* Verify token signature in constant time

To prevent timing side channel attacks

* Run cheap checks first in token validation process

Expensive checks such as the nonce lookup on the database or the
signature check can be run after cheap/fast checks.
2020-03-02 10:04:36 -06:00
Omar Roth e21f770485
Fix status check for channel page 2020-02-28 15:57:45 -05:00
Omar Roth 697c00dccf
Sanitize PLID 2020-02-28 14:10:01 -05:00
Omar Roth 1caf6a3298
Fix deadlock when updating notifications 2020-02-28 13:13:48 -05:00
Omar Roth 02fd02d482
Remove DB array concatenation 2020-02-28 12:14:29 -05:00
Pedro Lucas Porcellis 239fb0db94
Remove duplicated Github logo on footer (#986)
* Remove duplicated Github logo on footer
2020-02-20 18:50:54 -05:00
Omar Roth 43da06a354
Remove temp fix for crystal/crystal-lang#7383 2020-02-20 18:30:46 -05:00
Omar Roth fea6b67067
Remove 'type' attribute from community embed 2020-02-20 18:30:46 -05:00
Leon Klingele bc9dc3bf1e
Update code formatting for Crystal 0.33.0
Crystal 0.33.0 introduced some changes to to the code formatter.
Run "crystal tool format" so CI doesn't fail anymore.
2020-02-15 19:52:28 +01:00
Leon Klingele e3c10d779d
Add support to read config from environment variable
Try to read app config from the "INVIDIOUS_CONFIG" environment variable.
If the variable is undefined, read config from config.yml file as before.

Required by https://github.com/omarroth/invidious/pull/1015 et al.
2020-02-04 15:53:46 +01:00
Omar Roth 9841f74adc
Add handling for comments with no content 2020-02-01 12:14:37 -05:00
Omar Roth b56e493d92
Remove frameborder from community embeds 2020-02-01 11:23:12 -05:00
Omar Roth a2c5211b20
Check /browse_ajax for channel blocks 2020-02-01 11:23:12 -05:00
Omar Roth 648cc0f006
Refactor signature extraction 2020-01-24 17:02:28 -05:00
Alexander Pushkov 1fc9506442
Add audio mode link to items 2020-01-21 15:36:56 +03:00
Omar Roth 7baced75e5
Fix channel redirect 2020-01-14 08:21:17 -05:00
Omar Roth 7b88d0efe3
Minor refactor 2020-01-08 20:27:21 -05:00
Omar Roth 4aada65dae
Fix channel playlists for genre channels 2020-01-08 20:26:47 -05:00
Omar Roth 88a538e71b
Minor refactor for channel playlists 2019-12-05 15:47:35 -05:00
Omar Roth 513363504f
Add better error message for fetch_channel 2019-12-05 15:46:21 -05:00
Omar Roth 0e844edacb
Add support for pt-BR 2019-12-05 15:26:35 -05:00
Omar Roth 1499ce43bf
Add support for Romanian locale 2019-12-03 19:41:58 -05:00
Omar Roth 823603650f
Add support for /sorry/index CAPTCHA 2019-12-03 19:14:11 -05:00
Omar Roth 062867a38d
Strip domain from caption URLs 2019-12-01 17:52:39 -05:00
Omar Roth 04d56420d1 Run 'crystal tool format' 2019-11-28 08:20:44 -06:00
Omar Roth a017574f74 Add support for force_resolve to QUIC client 2019-11-28 08:19:28 -06:00
Omar Roth 0e3a48ff76
Update QUICPool 2019-11-24 13:41:47 -05:00
edumoreira1506 48cbe45a9d Add Previous/Next page buttons at the top of the page 2019-11-20 15:59:07 -03:00
Omar Roth 276bf09238
Skip preferences for assets 2019-11-20 12:04:53 -05:00
Omar Roth d46b26e3bc
Use QUIC for connections to YouTube 2019-11-18 17:28:32 -05:00
Omar Roth 236c172c6f
Merge pull request #896 from sh4dowb/master
Fixed double quotes in meta description
2019-11-14 10:38:38 -05:00
Omar Roth c07cd3a856
Fix typo in playlist url 2019-11-14 10:11:33 -05:00
sh4dowb 79da61782b
Fixed double quotes in meta description 2019-11-11 19:00:23 +03:00
Omar Roth 8af87f1a8b
Fix updating of cookies 2019-11-10 10:02:02 -05:00
Omar Roth 494c954cbb
Add etag to /api/v1/annotations 2019-11-09 22:05:17 -05:00
Omar Roth 71bc9eea28
Add support for Anti-Captcha 2019-11-09 14:22:39 -05:00
Omar Roth e3b2bcfd06
Fix ID for search duration 2019-11-08 09:29:33 -05:00
Omar Roth 142d974641
Use force_resolve for search suggestions 2019-11-07 12:25:34 -05:00
Omar Roth 0e1d6aa85c
Update error messages for video extractor 2019-11-05 19:39:11 -05:00
Omar Roth bcdb8cd770
Fix default fo dark_mode 2019-11-04 17:08:13 -05:00
Omar Roth 7b2ca55089
Fix escaping in email query 2019-11-04 12:26:05 -05:00
Omar Roth f6ef0b684a
Fix word-break for links in channel RSS 2019-11-03 08:53:16 -05:00
Omar Roth 02e1cdf210
Add support for '/yts/img' endpoint 2019-11-01 12:02:38 -04:00
Omar Roth b58950c574
Fix decoding for channel playlists extractor 2019-11-01 12:00:59 -04:00
Omar Roth 833a60f29c
Update pubsub to use client pool 2019-11-01 07:34:36 -04:00
Omar Roth 13e7cca1a4
Bump read timeout 2019-10-28 12:34:50 -04:00
Omar Roth 0f3c477ff3
Remove dependency on ImageMagick (replace with rsvg-convert) 2019-10-28 10:49:05 -04:00
Omar Roth 25c8cd9246
Fix escaping for search params 2019-10-28 06:17:39 -04:00
Omar Roth c58841100a
Fix extractor for channel community cursor 2019-10-27 21:44:17 -04:00
Omar Roth 03e24cccd0
Add support for configurable administrator email 2019-10-27 14:18:07 -04:00
Omar Roth 35f011758d
Merge pull request #850 from XVnNzb2kFEhV9Tjm/master
Add Japanese translations
2019-10-27 14:09:31 -04:00
Omar Roth 2ebfaf76f2
Refactor continuation token handling 2019-10-27 13:50:42 -04:00
Omar Roth 0cf187dee7
Add support for image captcha in Google login 2019-10-27 00:19:05 -04:00
Omar Roth bdeb325bad
Fix monkeypatch for HTTP::Client 2019-10-26 11:51:23 -04:00
Omar Roth a1225b6d0d
Sanitize input to decode_length_seconds 2019-10-26 10:17:25 -04:00
XVnNzb2kFEhV9Tjm f0368b02c4 Add Japanese translations 2019-10-26 18:34:25 +09:00
Omar Roth 202de1436d
Fix broken connections in pool 2019-10-25 23:06:08 -04:00
Omar Roth 7f8746fcd4
Remove invalid connections from pool 2019-10-25 22:40:53 -04:00
Omar Roth e05a25d701
Vary user-agent 2019-10-25 18:02:33 -04:00
Omar Roth 6930570fa2
Add HTTPClient pool 2019-10-25 12:58:16 -04:00
Omar Roth aba2c5b938
Remove code for /api/v1/insights 2019-10-25 12:25:57 -04:00
Omar Roth 159b4f9734
Format source 2019-10-21 21:40:03 -04:00
Omar Roth 46a737c7a1
Skip deleted videos in playlist 2019-10-21 19:00:56 -04:00
Omar Roth c3e57f1fdd
Fix typo in footer 2019-10-20 23:02:16 -04:00
Omar Roth a9af484412
Merge pull request #839 from TheFrenchGhosty/crypto
Add protocol to the cryptocurrencies
2019-10-20 22:39:24 -04:00
Omar Roth 007646774e
Fix typo in English locale 2019-10-20 21:01:27 -04:00
Omar Roth 2d78e35e16
Fix typo in syncing user preferences 2019-10-20 20:58:50 -04:00
Omar Roth 7524b5e349
Move feed_menu and default_home into user preferences 2019-10-20 20:43:33 -04:00
Omar Roth 2a04a48b89
Fix redirect for livestreams 2019-10-20 12:48:55 -04:00
TheFrenchGhosty 3cbdaab81e Add protocol to the cryptocurrencies 2019-10-19 20:23:27 +02:00
Omar Roth 2a4b252a9d
Only force resolve for www.youtube.com 2019-10-18 12:41:03 -04:00
Omar Roth bf48809b61
Allow unlisted playlists to be viewed from /api/v1/playlists/ 2019-10-16 08:21:26 -04:00
Omar Roth 3f3e52d7ae
Fix indexId for created playlist video 2019-10-15 22:09:01 -04:00
Omar Roth be055d9dcb
Add support for custom playlists 2019-10-15 21:17:14 -04:00
Omar Roth 1e34a61911
Fix white-space for RSS feeds 2019-10-14 21:07:07 -04:00
Omar Roth 97bd1da2a2
Remove SSL redirect 2019-10-14 21:07:07 -04:00
Omar Roth 55f0a82249
Remove Patreon links 2019-10-12 10:07:18 -04:00
Omar Roth 7aada3f328
Avoid override for X-Client headers 2019-10-10 23:45:46 -04:00
Omar Roth dad885c051
Add YouTube-Client headers to HTTP requests 2019-10-10 22:03:39 -04:00
Omar Roth f5c7bbfda8
Add support for zh-TW translation 2019-10-09 10:23:26 -04:00
Omar Roth 2d59fdd178
Fix default value for empty description 2019-10-04 17:04:43 -04:00
Omar Roth c0796ac3d6
Add description to RSS body 2019-10-04 12:50:22 -04:00
Omar Roth 68be24ffc6
Refactor process_video_params 2019-10-04 12:23:28 -04:00
Omar Roth 9dcc87c705
Refactor storyboard generation 2019-10-04 10:26:02 -04:00
Omar Roth da07f99d3d
Bump supported Crystal version 2019-09-30 15:36:54 -04:00
Omar Roth eef66de68c
Merge pull request #743 from girst/rssparams
Forward query string parameters from Atom feeds
2019-09-30 15:36:35 -04:00
girst 4aa1180fce Forward parameters given in &params= from Atom feeds
Any parameters given in &params=... are appended to /watch URLs.  This
allows e.g. passing &raw=1&listen=1 to a playlist of music and use an
rss reader like newsboat as a media player, like so:

    https://invidio.us/feed/playlist/XXX?params=%26raw%3D1%listen%3D1

All three feeds--channels, playlists, subscriptions--are supported.
2019-09-30 17:48:13 +02:00
Omar Roth e390405d0c
Update privacy policy 2019-09-24 20:47:49 -04:00
Omar Roth f69f0b97f5
Add fix for index out of bounds during high load 2019-09-24 13:38:50 -04:00
Omar Roth 4361ea9686
Update DB calls for 0.31.0 2019-09-24 13:38:50 -04:00
Omar Roth 8c2ddb0255
Add config options for host binding and port 2019-09-24 13:38:50 -04:00
Omar Roth 466a5a932b
Add support for Turkish translation 2019-09-24 13:38:50 -04:00
leonklingele 1aefc5b540 Update to Crystal 0.31.0, resolve compiler deprecation warnings, update dependencies (#764)
* shard: update to crystal 0.31.0

Additionally, no longer use the Crystal "markdown" library which has
been removed from the Crystal stdlib in version 0.31.0.
See https://github.com/crystal-lang/crystal/pull/8115.

Also fix some deprecation warnings using the following commands:

    find . \( -type d -name .git -prune \) -o -type f -exec sed -i 's/URI\.escape/URI\.encode_www_form/g' "{}" \;
    find . \( -type d -name .git -prune \) -o -type f -exec sed -i 's/URI\.unescape/URI\.decode_www_form/g' "{}" \;
    sed -i 's/while \%pull\.kind \!\= \:end_object/until \%pull\.kind\.end_object\?/g' src/invidious/helpers/patch_mapping.cr
2019-09-24 13:31:33 -04:00
Omar Roth 1085ca4a2d
Fix typo in Google login 2019-09-22 09:54:54 -04:00
Omar Roth cfb68e3bff
Add additional handling for unplayable videos 2019-09-21 20:06:08 -04:00
Omar Roth a006963fb8
Update Google login 2019-09-21 20:06:08 -04:00
Omar Roth b1fc80b79a
Update sub_count extractor 2019-09-12 21:09:23 -04:00
Omar Roth 50d793e49b
Hide video count for auto-generated channels 2019-09-12 13:11:21 -04:00
Omar Roth 34c43b8349
Add support for abbreviated sub count in search 2019-09-12 13:06:27 -04:00