Skip to content
Snippets Groups Projects
Commit 7fc1aad1 authored by Richard van der Hoff's avatar Richard van der Hoff
Browse files

Drop search values with nul characters

https://github.com/matrix-org/synapse/issues/2187 contains a report of a port
failing due to nul characters somewhere in the search table. Let's try dropping
the offending rows.
parent bf86a41e
Branches
Tags
No related merge requests found
......@@ -376,10 +376,13 @@ class Porter(object):
" VALUES (?,?,?,?,to_tsvector('english', ?),?,?)"
)
rows_dict = [
dict(zip(headers, row))
for row in rows
]
rows_dict = []
for row in rows:
d = dict(zip(headers, row))
if "\0" in d['value']:
logger.warn('dropping search row %s', d)
else:
rows_dict.append(d)
txn.executemany(sql, [
(
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment