devol
/
searx
mirror of https://github.com/searx/searx
1
0
Fork 0
Code Issues Releases Wiki Activity
4,047 Commits 19 Branches 18 Tags 56 MiB
Commit Graph

4047 Commits

Author SHA1 Message Date
Adam Tauber 4c631ac6d0 [fix] remove debug code 2021-03-15 21:47:27 +01:00
Noémi Ványi 8158d8654a fix Microsoft Academic engine 2021-03-15 20:21:28 +01:00
Adam Tauber f97b4ff7b6 [fix] update youtube_noapi paging 2021-03-15 17:22:31 +01:00
Adam Tauber dd34ac396c
Merge pull request #2652 from kvch/solr-engine 
Add Apache Solr engine
 2021-03-15 15:39:39 +01:00
Alexandre Flament 1664258061
Merge pull request #2655 from return42/fix-imports 
[fix] remove unused import from yahoo-news engine
 2021-03-15 08:38:34 +01:00
Alexandre Flament 5b176b3496
Merge pull request #2659 from MarcAbonce/onions-http-fix 
Fix HTTP error in onion engines
 2021-03-15 08:33:38 +01:00
Alexandre Flament 0b71d61dfc
Merge pull request #2654 from return42/acgsou 
[drop] Acgsou engine - www.acgsou.com no longer exists
 2021-03-15 08:27:15 +01:00
Marc Abonce Seguin f4a0a4d756 fix HTTP error in onion engines 
regression from https://github.com/searx/searx/pull/2641
most onion websites only serve HTTP, so it must be enabled
 2021-03-14 20:23:07 -07:00
Markus Heiser 6e1f1085ef [fix] remove unused import from yahoo-news engine 
Signed-off-by: Markus Heiser <markus@darmarit.de>
 2021-03-14 15:13:57 +01:00
Markus Heiser 3703ebb22a [drop] Acgsou engine - www.acgsou.com no longer exists 
- https://www.acgsou.com/ acgsou.com is redirected to 36dm.club
- @rinpatch do not plan on maintaining the engine [1]

[1] https://github.com/searx/searx/pull/1283#issuecomment-798783585

Signed-off-by: Markus Heiser <markus@darmarit.de>
 2021-03-14 11:49:18 +01:00
Noémi Ványi ff527e2681 Add Solr engine 2021-03-13 21:18:09 +01:00
Alexandre Flament 9292571304
Merge pull request #2346 from dalf/upgrade-oscar 
[mod] oscar: upgrade dependencies
 2021-03-13 09:29:13 +01:00
Noémi Ványi 22a2e54455
Merge pull request #2651 from searx/dependabot/pip/master/sphinx-3.5.2 
Bump sphinx from 3.5.1 to 3.5.2
 2021-03-12 20:19:38 +01:00
dependabot[bot] 863546c1ae
Bump sphinx from 3.5.1 to 3.5.2 
Bumps [sphinx](https://github.com/sphinx-doc/sphinx) from 3.5.1 to 3.5.2.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/3.x/CHANGES)
- [Commits](https://github.com/sphinx-doc/sphinx/compare/v3.5.1...v3.5.2)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-03-12 19:13:32 +00:00
Noémi Ványi c9d46edb29
Merge pull request #2650 from searx/dependabot/pip/master/sphinx-tabs-2.1.0 
Bump sphinx-tabs from 2.0.1 to 2.1.0
 2021-03-12 20:12:45 +01:00
dependabot[bot] 31c5032548
Bump sphinx-tabs from 2.0.1 to 2.1.0 
Bumps [sphinx-tabs](https://github.com/executablebooks/sphinx-tabs) from 2.0.1 to 2.1.0.
- [Release notes](https://github.com/executablebooks/sphinx-tabs/releases)
- [Changelog](https://github.com/executablebooks/sphinx-tabs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/executablebooks/sphinx-tabs/compare/v2.0.1...v2.1.0)

Signed-off-by: dependabot[bot] <support@github.com>
 2021-03-12 19:03:57 +00:00
Alexandre Flament 92dd5e245e
Merge pull request #2626 from mikeri/solidtorrents 
Add Solid Torrents engine
 2021-03-12 19:45:22 +01:00
Alexandre Flament a1a492baed
Merge pull request #2641 from dalf/disable_http_by_default 
[mod] by default allow only HTTPS, not HTTP
 2021-03-12 19:21:46 +01:00
Alexandre Flament af3e969c5a
Merge pull request #2642 from return42/fix-apkmirror 
[fix] APKMirror engine - update xpath selectors and fix img_src
 2021-03-11 09:48:31 +01:00
Alexandre Flament 8b650e6a2d
Merge pull request #2643 from return42/fix-makefile 
[fix] make targets engines.languages and useragents.update
 2021-03-11 09:44:30 +01:00
Alexandre Flament cb04d42806 [mod] oscar: update README.rst 2021-03-11 09:33:04 +01:00
Alexandre Flament 86912e2272 [mod] oscar: get bootstrap and typeahead from NPM 2021-03-11 09:33:01 +01:00
Alexandre Flament 44407353ef [mod] oscar: get leaflet and jquery from NPM 
easy to upgrade (package.json)
 2021-03-11 09:32:22 +01:00
Alexandre Flament c7133efb12 [mod] oscar: move compiled files to the src directory 2021-03-10 19:28:51 +01:00
Alexandre Flament eda3b513ac [mod] oscar: remove polyfills for Internet Explorer 2021-03-10 19:01:16 +01:00
Alexandre Flament 1268910274 [mod] oscar: remove unused images 2021-03-10 19:01:16 +01:00
Alexandre Flament bdb41bea7b [mod] theme: remove require-2.1.15.min.js 
See https://github.com/requirejs/requirejs/issues/1816

requirejs loads one file: leaflet.

This commit:
* removes requirejs
* load leaflet using <script src...> HTML tag in searx/templates/oscar/base.html
 2021-03-10 19:01:15 +01:00
Alexandre Flament 2f3d5ec2af [mod] oscar: upgrade npm dependencies 2021-03-10 19:01:14 +01:00
Markus Heiser 96422e5c9f [fix] APKMirror engine - update xpath selectors and fix img_src 
BTW: make the code slightly more readable

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-03-09 08:34:57 +01:00
Alexandre Flament ccf5ac9801
Merge pull request #2640 from return42/fix-yahoo-news 
[fix] rewrite Yahoo-News engine
 2021-03-08 19:03:41 +01:00
Markus Heiser c0d3183593 [fix] make targets engines.languages and useragents.update 
Since [PR 2600] is merged the update scripts for languages and useragent has
been moved to folder:

    searx_extra/update/

[PR 2600] https://github.com/searx/searx/pull/2600

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-03-08 16:14:33 +01:00
Markus Heiser d2faea423a [fix] rewrite Yahoo-News engine 
Many things have been changed since last review of this engine.  This patch fix
xpath selectors, implements suggestion and is a complete review / rewrite of the
engine.

Signed-off-by: Markus Heiser <markus@darmarit.de>
 2021-03-08 11:43:34 +01:00
Alexandre Flament 99e0651cea [mod] by default allow only HTTPS, not HTTP 
Related to https://github.com/searx/searx/pull/2373
 2021-03-08 11:35:08 +01:00
Michael Ilsaas 5549d58de3 Add Solid Torrents engine 2021-03-07 18:14:30 +01:00
Noémi Ványi 0d8b369b5b
Merge pull request #2615 from searx/engine-data 
Add ability to send engine data to subsequent requests
 2021-03-06 12:17:10 +01:00
Adam Tauber 44f4a9d49a [enh] add ability to send engine data to subsequent requests 2021-03-06 12:12:35 +01:00
Alexandre Flament 87f4cc4a9e
Merge pull request #2631 from searx/update_data_update_languages.py 
Update searx.data - update_languages.py
 2021-03-06 10:03:00 +01:00
Alexandre Flament 63e696372b
Merge pull request #2634 from return42/fedora 
[mod] LXC switch to Fedora 33 / Fedora 31 reached its EOL
 2021-03-05 21:56:18 +01:00
Alexandre Flament 70c38a93d0
Merge pull request #2635 from return42/einit 
[mod] don't dump traceback of SearxEngineResponseException on init
 2021-03-05 21:55:00 +01:00
Markus Heiser 4845183128 [mod] don't dump traceback of SearxEngineResponseException on init 
When initing engines a "SearxEngineResponseException" is logged very verbose,
including full traceback information:

    ERROR:searx.engines:yggtorrent engine: Fail to initialize
    Traceback (most recent call last):
      File "share/searx/searx/engines/__init__.py", line 293, in engine_init
        init_fn(get_engine_from_settings(engine_name))
      File "share/searx/searx/engines/yggtorrent.py", line 42, in init
        resp = http_get(url, allow_redirects=False)
      File "share/searx/searx/poolrequests.py", line 197, in get
        return request('get', url, **kwargs)
      File "share/searx/searx/poolrequests.py", line 190, in request
        raise_for_httperror(response)
      File "share/searx/searx/raise_for_httperror.py", line 60, in raise_for_httperror
        raise_for_captcha(resp)
      File "share/searx/searx/raise_for_httperror.py", line 43, in raise_for_captcha
        raise_for_cloudflare_captcha(resp)
      File "share/searx/searx/raise_for_httperror.py", line 30, in raise_for_cloudflare_captcha
        raise SearxEngineCaptchaException(message='Cloudflare CAPTCHA', suspended_time=3600 * 24 * 15)
    searx.exceptions.SearxEngineCaptchaException: Cloudflare CAPTCHA, suspended_time=1296000

For SearxEngineResponseException this is not needed.  Those types of exceptions
can be a normal use case.  E.g. for CAPTCHA errors like shown in the example
above. It should be enough to log a warning for such issues:

    WARNING:searx.engines:yggtorrent engine: Fail to initialize // Cloudflare CAPTCHA, suspended_time=1296000

closes: #2612

Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-03-05 17:26:22 +01:00
Markus Heiser 0305775e29 [mod] LXC switch to Fedora 33 / Fedora 31 reached its EOL 
Signed-off-by: Markus Heiser <markus.heiser@darmarit.de>
 2021-03-05 13:17:47 +01:00
Alexandre Flament 0165e14a7f
Merge pull request #2632 from searx/update_data_update_wikidata_units.py 
Update searx.data - update_wikidata_units.py
 2021-03-05 11:59:44 +01:00
Alexandre Flament 152f6fc1da
Merge pull request #2630 from searx/update_data_update_ahmia_blacklist.py 
Update searx.data - update_ahmia_blacklist.py
 2021-03-05 11:59:20 +01:00
Alexandre Flament d7fb55a774
Merge pull request #2633 from searx/update_data_update_currencies.py 
Update searx.data - update_currencies.py
 2021-03-05 11:59:05 +01:00
dalf 1e8b846954 Update searx.data - update_currencies.py 2021-03-05 10:56:57 +00:00
dalf 2f8a708481 Update searx.data - update_wikidata_units.py 2021-03-05 10:56:49 +00:00
dalf d9dc3376d0 Update searx.data - update_languages.py 2021-03-05 10:56:46 +00:00
dalf 2857473553 Update searx.data - update_ahmia_blacklist.py 2021-03-05 10:56:33 +00:00
Alexandre Flament 10ecc303c9
Fix integration.yml 
Don't run twice the workflow on PR opened from the same repository.
 2021-03-05 11:54:45 +01:00
Alexandre Flament 245f8626dd
Fix data-update.yml, run once a month 2021-03-05 11:12:31 +01:00