[#17085] - Use of stems in finder index in contrast to fulltext search
- Closed
- 4 Jun 2018
- Medium
- Build: master
- # 17085
Steps to reproduce the issue
- Install second language german
- make german the default language
- Create two articles. Place the word "Heiterkeit" in the first one and "Heiterung" in the second one. Both words have the stem "heiter".
- configure finder indexer to use stem and snowball
- install a stemmer implementation for php
- Build finder index
- Type "Heiter" into finder's search field. You will see "Heiterkeit" and "Heiterung" as proposal.
- Ich you search for "Heiterkeit" you will also find the article with "Heiterung"
- But if you search for "Heiter" you will not find any of the above created articles
- If you use a fulltext search in contrast (joomla's search component)and you search for "heiter" you will find both
- If you use a fulltext search and search for "Heiterkeit" you will only find on article, but not the one including "Heiterung"
Expected result
Using finder for searching should find both articles if searchd for stem "Heiter"
Using finder should not find "Heiterung" if searching for "Heiterkeit"
Actual result
No results for search
System information (as much as possible)
Joomla only.
Additional comments
Is this the intedend behavior of the finder component? Means: it's not a but, it's the intended behavior? If it is not the intende behavior, the fix dould be done with one line of code in file administrator/components/com_finder/helpers/indexer/query.php
Short summary:
Findex Index
search for "Heiter": no results
search for "Heiterkeit": finds "Heiterkeit" and "Heiterung" both words fully marked as result
Search
search for "Heiter": finds "Heiterkeit" and "Heiterung" in both words only "Heiter" marked as result
search for "Heiterkeit": finds only "Heiterkeit"
For PHP 5 we use pecl's stem from https://pecl.php.net
pecl install stemFor PHP 7 pecl no longer provides a stem implementation. In this case we build it like this:
mkdir /tmp/stem && cd /tmp/stem && \
curl -s -L http://pecl.php.net/get/stem-1.5.1.tgz | tar xzf - && \
cd stem-1.5.1 && \
curl -s -L "https://bugs.php.net/patch-display.php?bug_id=71091&patch=feature-support-php5-and-php7&revision=1457366472&download=1" | patch -p1 && \
sed "s/821813b35d88263c9b8b43b5202ca67a/$(md5sum stem.c | cut -d ' ' -f1)/" ../package.xml > package.xml && \
yes yes | pecl install package.xml && \
cd /tmp && \
rm -Rf stem && \
echo "extension=stem.so" > /etc/php.d/stem.ini
```<hr /><sub>This comment was created with the <a href="https://github.com/joomla/jissues">J!Tracker Application</a> at <a href="https://issues.joomla.org/tracker/joomla-cms/17085">issues.joomla.org/tracker/joomla-cms/17085</a>.</sub>| Status | New | ⇒ | Discussion |
| Labels |
Added:
J3 Issue
|
||
After some considerations, I would say that this is the way it is supposed to work. In this specific situation, I expect that the stemmer identified the "-er" of "Heiter" as a suffix that can be removed and thus it wont find any results. Thus I would say that this is intended behavior.
| Status | Discussion | ⇒ | Expected Behaviour |
| Closed_Date | 0000-00-00 00:00:00 | ⇒ | 2018-06-04 03:56:37 |
| Closed_By | ⇒ | franz-wohlkoenig |
| Status | Expected Behaviour | ⇒ | Closed |
| Closed_By | franz-wohlkoenig | ⇒ | joomla-cms-bot |
closed as expected Behaviour as stated above. Issue can always reopened for ongoing Discussion.
This comment was created with the J!Tracker Application at issues.joomla.org/tracker/joomla-cms/17085.
Set to "closed" on behalf of @franz-wohlkoenig by The JTracker Application at issues.joomla.org/joomla-cms/17085
What stemmer did you install?