DGNum/experiENS
6
0
Fork 0
Code Issues 11 Pull requests 1 Projects Releases Packages Wiki Activity Actions

Remove standard useless token filter

Browse source
This commit is contained in:
Robin Champenois 2021-06-28 22:09:08 +02:00
parent 3c2f93bccb
commit 22b5016687
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
avisstage/documents.py
View file

@ -15,7 +15,7 @@ stage.settings(
text_analyzer = analyzer(
'default',
tokenizer="standard",
filter=['lowercase', 'standard', 'asciifolding',
filter=['lowercase', 'asciifolding',
token_filter("frstop", type="stop", stopwords="_french_"),
token_filter("frsnow", type="snowball", language="French")])
stage.analyzer(text_analyzer)