Skip to content
Snippets Groups Projects
  1. Nov 04, 2022
  2. Nov 03, 2022
  3. Nov 02, 2022
  4. Nov 01, 2022
  5. Oct 31, 2022
  6. Oct 28, 2022
  7. Oct 27, 2022
  8. Oct 26, 2022
  9. Oct 25, 2022
    • James Salter's avatar
      Unified search query syntax using the full-text search capabilities of the underlying DB. (#11635) · d902181d
      James Salter authored
      Support a unified search query syntax which leverages more of the full-text
      search of each database supported by Synapse.
      
      Supports, with the same syntax across Postgresql 11+ and Sqlite:
      
      - quoted "search terms"
      - `AND`, `OR`, `-` (negation) operators
      - Matching words based on their stem, e.g. searches for "dog" matches
        documents containing "dogs". 
      
      This is achieved by 
      
      - If on postgresql 11+, pass the user input to `websearch_to_tsquery`
      - If on sqlite, manually parse the query and transform it into the sqlite-specific
        query syntax.
      
      Note that postgresql 10, which is close to end-of-life, falls back to using
      `phraseto_tsquery`, which only supports a subset of the features.
      
      Multiple terms separated by a space are implicitly ANDed.
      
      Note that:
      
      1. There is no escaping of full-text syntax that might be supported by the database;
        e.g. `NOT`, `NEAR`, `*` in sqlite. This runs the risk that people might discover this
        as accidental functionality and depend on something we don't guarantee.
      2. English text is assumed for stemming. To support other languages, either the target
        language needs to be known at the time of indexing the message (via room metadata,
        or otherwise), or a separate index for each language supported could be created.
      
      Sqlite docs: https://www.sqlite.org/fts3.html#full_text_index_queries
      Postgres docs: https://www.postgresql.org/docs/11/textsearch-controls.html
      Unverified
      d902181d
    • Olivier Wilkinson (reivilibre)'s avatar
Loading