Page MenuHomePhabricator
Feed Advanced Search

Oct 7 2015

joshuaspence created T9526: Support IAM credentials for Elasticsearch.
Oct 7 2015, 5:13 PM · Search, Elasticsearch

Sep 23 2015

chad renamed T9460: Unable to search for open tasks using Elasticsearch from Unable to search for open tasks to Unable to search for open tasks using Elasticsearch.
Sep 23 2015, 2:59 AM · Elasticsearch, Search
joshuaspence added a comment to T9460: Unable to search for open tasks using Elasticsearch.

It seems that this is not limited to Maniphest, it applies to all search documents.

Sep 23 2015, 1:57 AM · Elasticsearch, Search
joshuaspence created T9460: Unable to search for open tasks using Elasticsearch.
Sep 23 2015, 1:56 AM · Elasticsearch, Search

Aug 26 2015

joshuaspence added a comment to T8602: "Merge Duplicate Tasks" shows results in wrong order with ElasticSearch.

I applied the following change locally. I'm not convinced that it is the most correct solution, but it seems to have worked for our install:

Aug 26 2015, 10:06 PM · Elasticsearch, Search

Aug 17 2015

joshuaspence updated subscribers of T8602: "Merge Duplicate Tasks" shows results in wrong order with ElasticSearch.
Aug 17 2015, 9:44 PM · Elasticsearch, Search
joshuaspence added a comment to T8602: "Merge Duplicate Tasks" shows results in wrong order with ElasticSearch.

Comparing the mappings before and after (with curl 'http://localhost:9200/phabricator/_mappings?pretty=true'):

Aug 17 2015, 7:21 AM · Elasticsearch, Search
joshuaspence added a comment to T8602: "Merge Duplicate Tasks" shows results in wrong order with ElasticSearch.

I've made some small progress here.

Aug 17 2015, 6:26 AM · Elasticsearch, Search

Jul 23 2015

joshuaspence claimed T8602: "Merge Duplicate Tasks" shows results in wrong order with ElasticSearch.
Jul 23 2015, 8:59 AM · Elasticsearch, Search

Jul 8 2015

chad removed a member for Elasticsearch: chad.
Jul 8 2015, 7:39 PM

Jun 18 2015

joshuaspence created T8602: "Merge Duplicate Tasks" shows results in wrong order with ElasticSearch.
Jun 18 2015, 12:06 PM · Elasticsearch, Search
joshuaspence renamed T8598: Incorrect Elasticsearch index from Incorrect Elasticsearch inder to Incorrect Elasticsearch index.
Jun 18 2015, 8:14 AM · Elasticsearch, Search
joshuaspence created T8598: Incorrect Elasticsearch index.
Jun 18 2015, 5:34 AM · Elasticsearch, Search

May 28 2015

joshuaspence claimed T5282: Provide documentation on setting up ElasticSearch.

I set this up recently and can probably flesh out some documentation.

May 28 2015, 9:07 PM · Elasticsearch, Documentation
JoggerTech added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

Can you tell me the configuration setup that you guys are using:
OS, core#, memory (size, speed), SSD, php, mysql?

May 28 2015, 3:11 AM · Elasticsearch
JoggerTech added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.
php -v
PHP 5.5.9-1ubuntu4.7 (cli) (built: Mar 16 2015 20:47:39)
Copyright (c) 1997-2014 The PHP Group
Zend Engine v2.5.0, Copyright (c) 1998-2014 Zend Technologies
    with Zend OPcache v7.0.3, Copyright (c) 1999-2014, by Zend Technologies
May 28 2015, 3:10 AM · Elasticsearch

May 25 2015

chad added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

I don't know if it's worth noting, but Ubuntu 10.04 was end of life'd last month (it's 5 years old). What versions of PHP/MySQL are you running on it?

May 25 2015, 4:01 PM · Elasticsearch
JoggerTech added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

2 minute delays between prints.
Maybe an incorrect assessment, but I see there is a direct relationship to the my.conf vs how much mem/swap is used once I start phd; but always max CPU and obviously this impacts severely apache browsing and conduit api response

May 25 2015, 1:59 PM · Elasticsearch
epriestley added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

Where are the two-second delays occurring? Everything in that trace looks like it happens in no more than a few milliseconds.

May 25 2015, 1:54 PM · Elasticsearch
JoggerTech added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

git pull

remote: Counting objects: 19, done.
remote: Compressing objects: 100% (19/19), done.
remote: Total 19 (delta 15), reused 4 (delta 0), pack-reused 0
Unpacking objects: 100% (19/19), done.
From git://github.com/facebook/libphutil
   4e0febf..672c0f7  master     -> origin/master
Updating 4e0febf..672c0f7
Fast-forward
 .arcconfig                                    | 1 -
 src/daemon/PhutilDaemon.php                   | 5 +++--
 src/daemon/PhutilDaemonHandle.php             | 7 +++++--
 src/future/exec/CommandException.php          | 2 +-
 src/moduleutils/PhutilLibraryMapBuilder.php   | 4 ++--
 src/serviceprofiler/PhutilServiceProfiler.php | 4 ++--
 6 files changed, 13 insertions(+), 10 deletions(-)
May 25 2015, 1:50 PM · Elasticsearch
epriestley added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

Can you update libphutil and retry that? The duration printouts are bugged until rPHU65819efa.

May 25 2015, 1:44 PM · Elasticsearch
JoggerTech added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.
KiB Mem:  16120708 total, 15954548 used,   166160 free,    50420 buffers
KiB Swap: 16457724 total,  1017324 used, 15440400 free.  2086480 cached Mem
May 25 2015, 1:41 PM · Elasticsearch
epriestley added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

Can you run bin/phd debug taskmaster for a minute or so and show me the output?

May 25 2015, 1:24 PM · Elasticsearch
JoggerTech added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

I did the following:
/bin/phd stop

May 25 2015, 1:07 PM · Elasticsearch
JoggerTech added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.
> bin/phd status
Log Daemon       Host      Overseer Started                 Class                                Arguments
229 24793:p2icsv localhost 24793    May 25 2015, 6:30:38 AM PhabricatorRepositoryPullLocalDaemon
230 24793:gxho6u localhost 24793    May 25 2015, 6:30:38 AM PhabricatorTriggerDaemon
231 24793:2pttlj localhost 24793    May 25 2015, 6:30:38 AM PhabricatorTaskmasterDaemon
232 24793:ncviya localhost 24793    May 25 2015, 6:30:38 AM PhabricatorTaskmasterDaemon
233 24793:hqcy3p localhost 24793    May 25 2015, 6:30:38 AM PhabricatorTaskmasterDaemon
234 24793:yrrdmd localhost 24793    May 25 2015, 6:30:38 AM PhabricatorTaskmasterDaemon
May 25 2015, 12:39 PM · Elasticsearch
epriestley added a comment to T8306: Understanding phd, memory limitations, elasticsearch index slowness.

These numbers are wildly out of line with expectations. For comparison, I just ran a similar workload on this machine:

May 25 2015, 11:12 AM · Elasticsearch
JoggerTech updated the task description for T8306: Understanding phd, memory limitations, elasticsearch index slowness.
May 25 2015, 6:37 AM · Elasticsearch
JoggerTech renamed T8306: Understanding phd, memory limitations, elasticsearch index slowness from Understanding phd, memory limitations, elasticsearch to Understanding phd, memory limitations, elasticsearch index slowness.
May 25 2015, 6:22 AM · Elasticsearch
JoggerTech updated the task description for T8306: Understanding phd, memory limitations, elasticsearch index slowness.
May 25 2015, 5:18 AM · Elasticsearch
JoggerTech added a project to T8306: Understanding phd, memory limitations, elasticsearch index slowness: Elasticsearch.
May 25 2015, 5:15 AM · Elasticsearch

May 12 2015

tycho.tatitscheff added a comment to T5282: Provide documentation on setting up ElasticSearch.

@epriestley , so is their a way to provide special configurartion ? Can you give me some basic hints ?

May 12 2015, 7:10 PM · Elasticsearch, Documentation
epriestley updated subscribers of T5282: Provide documentation on setting up ElasticSearch.
May 12 2015, 5:43 PM · Elasticsearch, Documentation

Apr 17 2015

Pawka closed T7827: Boost Elasticsearch results if match is found on title instead of body. as Resolved.
Apr 17 2015, 6:14 AM · Elasticsearch, Search

Apr 16 2015

Pawka added a revision to T7827: Boost Elasticsearch results if match is found on title instead of body.: D12432: T7827: Boost Elasticsearch results on title match..
Apr 16 2015, 7:36 AM · Elasticsearch, Search

Apr 15 2015

Pawka updated the task description for T7827: Boost Elasticsearch results if match is found on title instead of body..
Apr 15 2015, 10:18 AM · Elasticsearch, Search
Pawka created T7827: Boost Elasticsearch results if match is found on title instead of body..
Apr 15 2015, 10:16 AM · Elasticsearch, Search

Apr 14 2015

chad updated subscribers of T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it.
Apr 14 2015, 2:42 AM · Search

Mar 13 2015

qgil renamed T6552: Implement partial / wildcard searching (Elasticsearch) from Implement partial / wildcard searching to Implement partial / wildcard searching (Elasticsearch).
Mar 13 2015, 5:00 PM · Elasticsearch, Search

Jan 8 2015

synsun.moon added a comment to T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it.

Thanks @fabe.
I resolved that issue after search init and change mysql config ( STRICT option ).
It works well but I found T6892.

Jan 8 2015, 10:22 AM · Search
synsun.moon created T6892: Invalid search result when I input less than 2 Korean character..
Jan 8 2015, 10:20 AM · Elasticsearch
fabe added a comment to T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it.

just run

./bin/search init

first.
This will create the needed elasticsearch index.

Jan 8 2015, 10:19 AM · Search
synsun.moon added a comment to T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it.

Thank you for your answer. But I met this error message.
after "search index --all"

[HTTP/404] Not Found
{"error":"IndexMissingException[[phabricator] missing]","status":404}

Is it need more configuration for this?

Jan 8 2015, 8:03 AM · Search
chad added a comment to T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it.

https://secure.phabricator.com/T5282#62676

Jan 8 2015, 5:56 AM · Search
synsun.moon added a comment to T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it.

Is there a temporary way to resolve this issue? ( Just only for wiki search )

Jan 8 2015, 5:54 AM · Search

Dec 22 2014

epriestley closed T5990: Elasticsearch search backend requires auto_create_index turned on as Resolved.

Presuming resolved by D10955, yell if I missed something or there's some followup.

Dec 22 2014, 11:55 PM · Elasticsearch, Search
epriestley closed T6780: Can't search an exact phrase in Phabricator as Resolved.

Closed by commit rPc953c0fedc17.

Dec 22 2014, 9:00 PM · Wikimedia, Search, Elasticsearch

Dec 18 2014

WikiChad added a revision to T6780: Can't search an exact phrase in Phabricator: D11011: Switch normal query from match to simple_query_string.
Dec 18 2014, 8:30 PM · Wikimedia, Search, Elasticsearch
epriestley added a comment to T6780: Can't search an exact phrase in Phabricator.

Yeah, this is specific to ElasticSearch -- exact phrase search works on this install with the MySQL backend T6747.

Dec 18 2014, 3:55 PM · Wikimedia, Search, Elasticsearch
qgil created T6780: Can't search an exact phrase in Phabricator.
Dec 18 2014, 1:28 PM · Wikimedia, Search, Elasticsearch

Dec 4 2014

qgil removed a project from T5990: Elasticsearch search backend requires auto_create_index turned on: Wikimedia.
Dec 4 2014, 12:37 PM · Elasticsearch, Search
qgil moved T6552: Implement partial / wildcard searching (Elasticsearch) from Backlog to Important on the Wikimedia board.
Dec 4 2014, 12:28 PM · Elasticsearch, Search
qgil added a project to T6552: Implement partial / wildcard searching (Elasticsearch): Wikimedia.
Dec 4 2014, 12:27 PM · Elasticsearch, Search
fabe added a comment to T6552: Implement partial / wildcard searching (Elasticsearch).

One way of doing this is by adjusting the mapping for the elasticsearch index (actually way more powerful than a wildcard search).
I currently switched to the mapping below (added as a template expecting the index to be named 'phabricator' and with an english language setting).
Feel free to change the min/max ngrams setting (e.g. 4 instead of 3 letter ngrams) if you get too many / few results.
If you like to switch to another language the docs to do so are here: http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/analysis-lang-analyzer.html
For it to take effect you have to delete the index and then reindex all objects (bin/index --all).

Dec 4 2014, 12:17 PM · Elasticsearch, Search

Nov 15 2014

chad added a comment to T6552: Implement partial / wildcard searching (Elasticsearch).

(I would like this tooooo)

Nov 15 2014, 5:51 AM · Elasticsearch, Search
chad triaged T6552: Implement partial / wildcard searching (Elasticsearch) as Normal priority.
Nov 15 2014, 5:50 AM · Elasticsearch, Search

Nov 14 2014

chad added a project to T6552: Implement partial / wildcard searching (Elasticsearch): Elasticsearch.
Nov 14 2014, 4:36 PM · Elasticsearch, Search

Nov 13 2014

chad added a subtask for T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it: T5282: Provide documentation on setting up ElasticSearch.
Nov 13 2014, 5:56 PM · Search
chad added a project to T2632: MyISAM fulltext does not support non-latin languages and we don't warn you about it: Elasticsearch.
Nov 13 2014, 5:50 PM · Search

Sep 30 2014

qgil moved T5990: Elasticsearch search backend requires auto_create_index turned on from Backlog to Details on the Wikimedia board.
Sep 30 2014, 7:22 PM · Elasticsearch, Search

Sep 22 2014

chad closed T6158: Test as Invalid.
Sep 22 2014, 2:13 PM · Roadmap, Elasticsearch
NSPIRIT created T6158: Test.
Sep 22 2014, 11:18 AM · Roadmap, Elasticsearch

Sep 2 2014

chad added a project to T4692: Slashes are being double-escaped (or not escaped?) when passed to ElasticSearch: Elasticsearch.
Sep 2 2014, 3:52 PM · Elasticsearch
chad added a project to T5282: Provide documentation on setting up ElasticSearch: Elasticsearch.
Sep 2 2014, 3:52 PM · Elasticsearch, Documentation
chad added a project to T5990: Elasticsearch search backend requires auto_create_index turned on: Elasticsearch.
Sep 2 2014, 3:50 PM · Elasticsearch, Search