remove fatal errors caused by usage of an outdated API(done)schema generator using querypath, prototype, solr 1.x(done)basic indexing nodes using language specific solr fields(done)queries(done)highlighter uses language specific stemming(done)move sub-module apachesolr_multilingual_advanced_solr to apachesolr_confgen(done)port all settings from 6.x(done)schema generator using querypath, complete, solr 1.x(done)refactor download of all config files zip(done)migrate variables to i18n_variables(done)word lists configurable within drupal admin interface(done)BoF @Drupal Con Munich(done)split Apache Solr Multilingual into two sub-modules to be prepared for a Search API Integration(done)bugfixing / testing(done)7.x-1.0-alpha1 release(done)fine tuned language facet(done)first simple tests and test base class for future testing(done)bugfixing / testing(done)7.x-1.0-alpha2 release(done)support multiple environments, p.e. one core per language(done)entity translation(done)spell checker(done)solr 3.x(done)wait for these patches to be committed:(done)wait for apachesolr 7.x-1.2 release containing our patches(done)7.x-1.0-beta1 release(done)bugfixes(done)7.x-1.0-beta2 release(done)i18n for taxonomy(done)bugfixes (ongoing)(done)GUI improvements(done)7.x-1.0-rc1 release(done)bugfixes(done)7.x-1.0-rc2 release(done)bugfixes(done)7.x-1.0 release(done)solr 4.x(done)multilingual settings for MLT blocks(done)7.x-1.1 release(done)- improved default configurations for different languages (partly done)
- support different stemmers for Solr 3.x and 4.x
- multilingual auto complete, n-gram
- CLIR (partly done)
- 7.x-2.0 release
Bonus, if we find native speakers to help us:
- Support Greek: #1287842: Support for Solr 3.x language specific filters (Greek, ...) (Greek-speaking users willing to help: klonos)
- Support Chinese: #1081850: Chinese language support
- ...
Notes:
- The generic part of config file generation has been moved to a separate module named Apache Solr Config Generator
A bug fix patch for Apache Solr Search is required: #1702788: content and teaser are empty if node->language is not default(done)A bug fix patch for Apache Solr Search is required: #1759004: apachesolr_search_custom_page_search_form_submit() kills all $_GET parameters(done)- We committed some patches to the variable module.
Therefore you have to use the current dev version of Variable 7.x-2.x until 7.x-2.2 will be released. - For entity translation a core patch might be needed http://drupal.org/files/d7-1823306-do-not-test.patch The issue is currently filed against drupal 8: #1823306: Language code is missing from $context when hook_field_attach_view_alter() is invoked from field_view_field()
These patches against the apachesolr module are essential to run the latest dev version of Apache Solr Multilingual: #1918012: Solr query needs to be aware of more context such as Search Page ID, #1918030: Allow contrib modules to add custom settings to search pages, #1896470: Integrate Apache Solr Common Configurations for Solr 3.x and 4.x (Highlighting broken)(done)- These patches against the apachesolr module improve the result: #1970648: sort block breaks multilingual sites, #1946132: ERROR: Warning: implode() [function.implode]: Invalid arguments passed in theme_apachesolr_search_snippets() (line 1708 of...)
Testing:
- Read through my slides to get a basic understanding of language specific full text searching: Language-Specific and Multilingual Full-Text Searching
- Install Apache Solr Multilingual and Apache Solr Config Generator and (some of) their sub-modules (in various order)
- Configure Apache Solr Multilingual in different ways and try the search
- Enable / disable different languages
- ...
Comments
Comment #1
mkalkbrennerThe todo list is just the result of a quick brainstorming. I already discovered other todos I solved quickly without adding them to the list.
Comment #2
mkalkbrennerhttp://drupal.org/project/solr_best_bets
https://github.com/nickveenhof/msc_solr_drupal/blob/master/thesis_acquia...
http://drupal.org/node/1669876
http://drupal.org/sandbox/cpliakas/1600962
http://drupal.org/node/1611504
Comment #3
nick_vhAlso 1 language per core and/or multiple languages per core should be discussed.
http://lucidworks.lucidimagination.com/display/lweug/Multilingual+Indexi...
Comment #4
klonos...less vague title for our dashboards.
Comment #5
mkalkbrenner@klonos: You're welcome.
I saw in your profile that you know Greek. Maybe you can help if it comes to testing a Greek setup or to define useful defaults for Greek.
Comment #6
klonosYep, Greek is my mama-tongue (born 'n' raised in Greece). Feel free to ping me when you need something Greek-related.
...one thing though Markus, could you move the list of tasks from #1 in the issue summary instead? This way we can use the revisions to see what was updated/changed when. Thanx in advance ;)
Comment #7
mkalkbrennerI moved the list.
There's already an issue for Greek: #1287842: Support for Solr 3.x language specific filters (Greek, ...)
It's old but I decided to move it forward from 6.x to 7.x
Comment #7.0
mkalkbrenneradded todo list
Comment #7.1
mkalkbrenneradded highlighting
Comment #7.2
mkalkbrennerThe generic part of config file generation has been moved to a separate module
Comment #7.3
mkalkbrenneradded i18n for taxonomy
Comment #7.4
mkalkbrennermove sub-module apachesolr_multilingual_advanced_solr to apachesolr_confgen
Comment #7.5
mkalkbrennersupport multiple environments, p.e. one core per language
Comment #7.6
mkalkbrennerbug fix patch for Apache Solr Search is required
Comment #8
klonosWow! ...you're on fire Markus ;)
...just a note to remember mentioning the newly created Apache Solr Config Generator module as a link to the project's page.
Comment #8.0
klonosschema generator using querypath, complete, solr 1.x
Comment #9
klonos..adding the "greek" tag in order to be able to track these issues easily.
Comment #9.0
klonosAdded links to the issues for Greek & Chinese support + a link to my profile since I'm willing to help with Greek-related things where I can.
Comment #9.1
mkalkbrennerrefactor download of all config files zip - done
Comment #9.2
mkalkbrennerplanned 7.x-1.0-alpha1 release
Comment #9.3
mkalkbrennerupdated
Comment #9.4
mkalkbrenneradded comments for BoF
Comment #9.5
mkalkbrenneradded testing section
Comment #9.6
mkalkbrenneradded info about variable
Comment #9.7
mkalkbrennerstatus update
Comment #9.8
mkalkbrennerdefault configurations for different languages
Comment #9.9
mkalkbrennerupdated progress
Comment #9.10
mkalkbrenneralpha1 release
Comment #9.11
mkalkbrennerfine tuned language facet
Comment #9.12
mkalkbrennerupdated
Comment #10
mkalkbrennermade some progress for entity translation:
#1820742: parameter $langcode of core function node_view() ignored
#1301252: Add support for Entity (field) Translation
Comment #11
nick_vhFollowing progress with lots of respect to you. You're doing a massively great job!
Comment #11.0
nick_vhentity translation
Comment #11.1
mkalkbrenneradded core issue
Comment #11.2
mkalkbrennerupdate on entity translation
Comment #11.3
mkalkbrennerspellcheck
Comment #11.4
mkalkbrenneradded reference to apachesolr patch (solr 3 highlight fix)
Comment #12
mkalkbrennerAs you can see on the roadmap, we're ready for the first beta release!
But before we release, we have to wait until these patches get committed to apachesolr itself:
If you want to help or speed up the release, review and comment these patches.
Comment #12.0
mkalkbrenneradded release plan
Comment #13
mkalkbrennerAll essential patches have been accepted and committed to apachesolr:
http://nickveenhof.be/blog/drupal-search-and-solr-office-hours-20120313
Comment #14
mkalkbrenner#1970648: sort block breaks multilingual sites
#1946132: ERROR: Warning: implode() [function.implode]: Invalid arguments passed in theme_apachesolr_search_snippets() (line 1708 of...)
Comment #14.0
mkalkbrennerall required patches to apachesolr are accepted - waiting for apachesolr 7.x-1.2 release
Comment #14.1
mkalkbrennerUpdated issue summary.
Comment #15
mkalkbrennerComment #16
mkalkbrennerComment #17
mkalkbrennerComment #18
mkalkbrennerComment #19
mkalkbrennerComment #20
mkalkbrennerSwitching to normal maintenance mode ... ;-)