Commit Graph

49 Commits

Author SHA1 Message Date
Eric Peterson aff7351fa5 Use non-deprecated TestPipeline static methods
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-11-25 15:22:32 +01:00
Eric Peterson 8006f8a602 Tag indexing logs with document type
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-10-10 18:02:33 +02:00
Camila Belo 60a912cd2c Rename param to page limit and validate its type
Signed-off-by: Camila Belo <camilaibs@gmail.com>
2022-10-04 10:54:09 +02:00
Emma Indal 814c8a61f6 Search engines to use resultPerPage param if provided
Co-authored-by: Camila Loiola <camilaibs@gmail.com>
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-10-04 10:54:09 +02:00
Fredrik Adelöw aaab1e34da Fix linting errors after #13392
Signed-off-by: Fredrik Adelöw <freben@gmail.com>
2022-08-30 13:44:09 +02:00
Fredrik Adelöw ef9ab322de it just keeps 🧹 -ing
Signed-off-by: Fredrik Adelöw <freben@gmail.com>
2022-08-18 17:21:00 +02:00
Eric Peterson a84aef3e1e Merge pull request #12534 from nodify-at/master 2022-07-18 11:36:58 +02:00
Eric Peterson c80d547dff Ignore most likely irrelevant typescript issues.
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-07-08 17:13:32 +02:00
Hasan Oezdemir ab338422e1 Feature: add a new option to set the batch size for elastic search engine, if not given the default batch size is 1.000
Signed-off-by: Hasan Oezdemir <21654050+nodify-at@users.noreply.github.com>
2022-07-08 12:39:22 +02:00
Camila Belo dcba440459 refactor: apply review suggestions
Signed-off-by: Camila Belo <camilaibs@gmail.com>
2022-07-05 12:02:21 +02:00
Emma Indal faa5dde25e feedback fixups
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-07-01 09:30:47 +02:00
Camila Belo 19bcc9d795 feat(search-backend-module-es): test error handling
Co-authored-by: Emma Indal <emma.indahl@gmail.com>
Signed-off-by: Camila Belo <camilaibs@gmail.com>
2022-06-28 13:46:13 +02:00
Emma Indal 197bca1bc0 Merge branch 'master' into emmai/search-error-handling 2022-06-28 13:01:11 +02:00
Eric Peterson 7a90b62aad Test the new client wrapper.
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-06-27 13:51:55 +02:00
Eric Peterson 68b7739aab Refactor Elasticsearch client calls into client wrapper and break out types
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-06-27 13:50:44 +02:00
Emma Indal 34c97eb35b switch to use .json instead of .send
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-22 14:06:09 +02:00
Emma Indal c30ecd900f ElasticSearch engine throw MissingIndexError if error type is index_not_found_exception
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-20 15:48:44 +02:00
Eric Peterson c7ce7b1eb0 Test rank handling in all search engines.
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-06-10 15:36:11 +02:00
Eric Peterson 915700f64f Set a pagination-aware rank value for all search engines.
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-06-10 15:36:11 +02:00
Emma Indal 0b8c1b93e2 setIndexTemplate to be directly responsible for calling putIndexTemplate
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-10 13:31:46 +02:00
Emma Indal 7c26e81120 add some more docs to the template body type as well as optional composed_of
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-10 10:33:29 +02:00
Emma Indal 535847cf14 changeset and api report updates
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-10 10:08:48 +02:00
Emma Indal 1b59892019 implement possibilities to set custom template on elastic search engine
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-10 10:03:25 +02:00
Emma Indal 28972473a0 rename ConcreteElasticSearchQuery -> ElasticSearchConcreteQuery
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-03 14:12:39 +02:00
Emma Indal 0afede342d clean up api report for search-backend-module-elasticsearch package
Signed-off-by: Emma Indal <emma.indahl@gmail.com>
2022-06-02 13:10:40 +02:00
Phil Kuang 281cec1b61 fix(elasticSearch): use more precise matching for query filters
Signed-off-by: Phil Kuang <pkuang@factset.com>
2022-05-27 10:00:55 -04:00
Phil Kuang 9eef9c9db4 fix(elasticSearch): do not define pageCursor on last page
Signed-off-by: Phil Kuang <pkuang@factset.com>
2022-05-12 21:32:44 -04:00
Fredrik Adelöw 16dcf2a807 Merge pull request #10981 from kuangp/feat/search/highlight
feat(search): highlight search result terms
2022-05-09 18:27:07 +02:00
Phil Kuang 3a74e203a8 feat(search): highlight search result terms
Signed-off-by: Phil Kuang <pkuang@factset.com>
2022-05-09 11:13:34 -04:00
Eric Peterson 71d3432710 Set the default batchSize to 1000 for all search engines.
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-05-01 16:19:58 +02:00
Phil Kuang a7f7a63d14 refactor(elasticsearch): support retrying failed deletion of stale indices
Signed-off-by: Phil Kuang <pkuang@factset.com>
2022-04-19 11:58:51 -04:00
Mike Lewis 62ee65422c elasticsearch: use new IndexableResultSet type as return type of engine#query
Signed-off-by: Mike Lewis <mtlewis@users.noreply.github.com>
2022-03-17 12:39:41 +00:00
Eric Peterson 3e54f6c436 Use @backstage/plugin-search-common instead of @backstage/search-common
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-03-04 18:47:55 +01:00
Eric Peterson 2c171166a0 Update ElasticSearchSearchEngine to be stream-based
Signed-off-by: Eric Peterson <ericpeterson@spotify.com>
2022-03-02 17:26:58 +01:00
Charles Lowell c47959856a Don't use initializer syntax for instantiating client
For some reason, the property initializer syntax stopped working. An
update to TypeScript? An update to Jest? Unknown, but sticking to the
less fancy constructor body to do property init seems to work.

Signed-off-by: Charles Lowell <cowboyd@frontside.com>
2021-12-15 15:30:30 +02:00
Charles Lowell 5515862338 Run api report and add minimal tsdoc.
Signed-off-by: Charles Lowell <cowboyd@frontside.com>
2021-12-14 20:39:55 +02:00
Charles Lowell 71472b7bd8 Remove tsdoc since it is now in the guide
Signed-off-by: Charles Lowell <cowboyd@frontside.com>
2021-12-14 16:52:59 +02:00
Charles Lowell 35e3f6f52e Add changes to API Report
Signed-off-by: Charles Lowell <cowboyd@frontside.com>
2021-12-14 16:42:18 +02:00
Charles Lowell 445a48e7eb 👍Use a separately maintained set of ElasticSearchClientOptions
This completely decouples us from any particular point release of the
ElasticSearch Client

Signed-off-by: Charles Lowell <cowboyd@frontside.com>
2021-12-14 13:51:02 +02:00
Charles Lowell 68512f5178 Add ability to re-use search cluster configuration from engine
Signed-off-by: Charles Lowell <cowboyd@frontside.com>
2021-12-14 13:50:58 +02:00
Fredrik Adelöw dcd1a0c3f4 Do not unpack arguments directly on exported items
Signed-off-by: Fredrik Adelöw <freben@gmail.com>
2021-12-07 19:42:10 +01:00
Patrik Oldsberg 8142a8ecb2 packages,plugins: add package documentation
Signed-off-by: Patrik Oldsberg <poldsberg@gmail.com>
2021-09-14 18:47:53 +02:00
Sam Robson 129bd23852 test: clientOptions config accessed but not required
Signed-off-by: Sam Robson <srobson@gocardless.com>
2021-09-13 14:24:52 +01:00
Sam Robson f0c2c81676 feat: add ssl requestUnauthorized config value
Signed-off-by: Sam Robson <srobson@gocardless.com>
2021-09-10 13:08:16 +01:00
Oliver Sand 532b4cc656 Rework search paging based on cursors
Signed-off-by: Oliver Sand <oliver.sand@sda-se.com>
2021-09-02 10:22:41 +02:00
Oliver Sand 81cf103cf6 Implement offset and limit based paging in elastic search engine
Signed-off-by: Oliver Sand <oliver.sand@sda-se.com>
2021-09-02 10:19:32 +02:00
Phil Kuang 76872096bf fix(elasticSearchEngine): optionally read auth config
Signed-off-by: Phil Kuang <pkuang@factset.com>
2021-08-06 11:05:22 -04:00
Jussi Hallila 54e1280b6a * Modify index/alias name handling.
* Change config key name to be all lowercase
* Documentation updates

Signed-off-by: Jussi Hallila <jussi@hallila.com>
2021-08-03 13:07:25 +02:00
Jussi Hallila d9c13d535b Implement ElasticSearch search engine
* Adding indexing, searching and default translator for ElasticSearch engine
* Modifying default backend to use ES if it is enabled
* Adding configuration schema to configure ElasticSearch 3 different ways
   * Elastic.co hosted solution
   * AWS hosted ElasticSearch Service
   * Custom, using standard ElasticSearch URL and auth info
* Add and modify some of the documentation regarding search

Signed-off-by: Jussi Hallila <jussi@hallila.com>
2021-07-30 14:26:32 +02:00