Free and Open, Distributed, RESTful Search Engine

Related tags

Searchjavasearch-engineelasticsearch
Overview

Elasticsearch

Elasticsearch is the distributed, RESTful search and analytics engine at the heart of the Elastic Stack. You can use Elasticsearch to store, search, and manage data for:

  • Logs

  • Metrics

  • A search backend

  • Application monitoring

  • Endpoint security

... and more!

To learn more about Elasticsearch’s features and capabilities, see our product page.

Get started

The simplest way to set up Elasticsearch is to create a managed deployment with Elasticsearch Service on Elastic Cloud.

If you prefer to install and manage Elasticsearch yourself, you can download the latest version from elastic.co/downloads/elasticsearch.

For more installation options, see the Elasticsearch installation documentation.

Upgrade

To upgrade from an earlier version of Elasticsearch, see the Elasticsearch upgrade documentation.

Build from source

Elasticsearch uses Gradle for its build system.

To build a distribution for your local OS and print its output location upon completion, run:

./gradlew localDistro

To build a distribution for another platform, run the related command:

./gradlew :distribution:archives:linux-tar:assemble
./gradlew :distribution:archives:darwin-tar:assemble
./gradlew :distribution:archives:windows-zip:assemble

To build distributions for all supported platforms, run:

./gradlew assemble

Distributions are output to distributions/archives.

To run the test suite, see TESTING.

Documentation

For the complete Elasticsearch documentation visit elastic.co.

For information about our documentation processes, see the docs README.

Contribute

For contribution guidelines, see CONTRIBUTING.

Questions? Problems? Suggestions?

  • To report a bug or request a feature, create a GitHub Issue. Please ensure someone else hasn’t created an issue for the same topic.

  • Need help using Elasticsearch? Reach out on the Elastic Forum or Slack. A fellow community member or Elastic engineer will be happy to help you out.

You might also like...
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.
This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

This project is a sample demo of Arxiv search related to AI/ML Papers built using Streamlit, sentence-transformers and Faiss.

Karn Deb 49 Oct 30, 2022
Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.
Google Project: Search and auto-complete sentences within given input text files, manipulating data with complex data-structures.

Auto-Complete Google Project In this project there is an implementation for one feature of Google's search engines - AutoComplete. Autocomplete, or wo

Hadassah Engel 10 Jun 20, 2022
Full-text multi-table search application for Django. Easy to install and use, with good performance.

django-watson django-watson is a fast multi-model full-text search plugin for Django. It is easy to install and use, and provides high quality search

Dave Hall 1.1k Jan 3, 2023
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

NeuML 3.1k Dec 31, 2022
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.
🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

🔍 Messages Searcher is make for search custom message in all channels in guild and dm.

Kaneki 33 Dec 31, 2022
Inverted index creation and query search mechanism on Wikipedia pages.

WikiPedia Search Engine Step 1 : Installing Requirements Install "stemming" module for python using pip. Step 2 : Parsing the Data To parse the data,

Piyush Atri 1 Nov 27, 2021
ForFinder is a search tool for folder and files
ForFinder is a search tool for folder and files

ForFinder is a search tool for folder and files. You can use that when you Source Code Analysis at your project's local files or other projects that you are download. Enter a root path and keyword to ForFinder.

Çağrı Aliş 7 Oct 25, 2022
Modular search for Django

Haystack Author: Daniel Lindsley Date: 2013/07/28 Haystack provides modular search for Django. It features a unified, familiar API that allows you to

Haystack Search 3.4k Jan 4, 2023
Full text search for flask.

flask-msearch Installation To install flask-msearch: pip install flask-msearch # when MSEARCH_BACKEND = "whoosh" pip install whoosh blinker # when MSE

honmaple 197 Dec 29, 2022
Comments
  • Redundant Code at line 73 in the source file MembersInjectorStore.java

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Elasticsearch Version

    master branch

    Installed Plugins

    No response

    Java Version

    bundled

    OS Version

    no

    Problem Description

    Redundant Code at line 73 in the source file MembersInjectorStore.java

    Steps to Reproduce

    no

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by liweixiesysu 0
  • Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Some (not all) elasticsearch snapshot indices failing to write to azure blob with I/O error

    Elasticsearch Version

    7.17.8

    Installed Plugins

    repository-azure

    Java Version

    bundled

    OS Version

    Linux elasticsearch-master-0 5.4.0-1086-azure #91~18.04.1-Ubuntu SMP Thu Jun 23 20:33:05 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

    Problem Description

    Elasticsearch running on kubernetes, installed via helm.

    Snapshot repo has been added and pointing to azure blob. Around 1/3 of the indices are failing when running the snapshot with the following error:

    INTERNAL_SERVER_ERROR: UncategorizedExecutionException[Failed execution]; nested: ExecutionException[java.io.IOException: Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: IOException[Unable to write blob indices/8FpoPDnXTWi4UEwmpsTqPA/0/__uTMAzEiZQAGT5uSvunSJiw]; nested: ReactiveException[java.io.IOException: null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: IOException[null: NIOFSIndexInput(path="/usr/share/elasticsearch/data/nodes/0/indices/a8W12fUDQPerYspC0uCgXA/0/index/_kup.fdt")]; nested: ClosedChannelException

    This smells to me like an azure issue however posting here first to try and get some kind of confirmation or consensus before I reach out to them.

    Steps to Reproduce

    add azure blob snapshot repo, create snapshot policy to capture everything, run policy

    Logs (if relevant)

    No response

    >bug needs:triage 
    opened by danfinn 0
  • NodeClient#executeLocally always executes action on the calling thread

    NodeClient#executeLocally always executes action on the calling thread

    Not sure if this is a bug or not but I found it surprising and think it's worthy of discussion. REST actions all run on a transport thread and typically call some method on a Client which ends up calling NodeClient#executeLocally and ultimately running a transport action on the local node. However AFAICT there's nowhere in this call stack which forks onto a different thread, even if the transport action would fork off onto a different thread when handling a transport request received from elsewhere.

    I mean this kinda makes sense, it's the TransportService that tracks which handlers fork where, and calls into the NodeClient bypass the TransportService, but still it seems like a potential source of inappropriate work on transport threads.

    Is that a known thing? Am I wrong to be surprised about this? (or indeed am I wrong about this behaviour?) Not much time to investigate further now so I'm opening this to make sure we discuss it.

    :Distributed/Network team-discuss Team:Distributed 
    opened by DaveCTurner 1
  • Improve scalability of BroadcastReplicationActions

    Improve scalability of BroadcastReplicationActions

    BroadcastReplicationAction derivatives (POST /<indices>/_refresh and POST /<indices>/_flush) are pretty inefficient when targeting high shard counts due to how TransportBroadcastReplicationAction works:

    • It computes the list of all target shards up-front on the calling (transport) thread.

    • It eagerly sends one request for every target shard in a tight loop on the calling (transport) thread.

    • It accumulates responses in a CopyOnWriteArrayList which takes quadratic work to populate, even though nothing reads this list until it's fully populated.

    • It then mostly discards the accumulated responses, keeping only the total number of shards, the number of successful shards, and a list of any failures.

    • Each failure is wrapped up in a ReplicationResponse.ShardInfo.Failure but then unwrapped at the end to be re-wrapped in a DefaultShardOperationFailedException.

    This commit fixes all this:

    • It avoids allocating a list of all target shards, instead iterating over the target indices and generating shard IDs on the fly.

    • ~The computation of the list of shards, and the sending of the per-shard requests, now happens on the relevant threadpool (REFRESH or FLUSH) rather than a transport thread.~ see https://github.com/elastic/elasticsearch/issues/92730

    • The per-shard requests are now throttled, with a meaningful yet fairly generous concurrency limit of #(data nodes) * 10.

    • Rather than accumulating the full responses for later processing we track the counts and failures directly.

    • The failures are tracked in a regular ArrayList, avoiding the accidentally-quadratic complexity.

    • The failures are tracked in their final form, skipping the unwrap-and-rewrap step at the end.

    Relates #77466

    >bug :Distributed/Network v8.7.0 
    opened by DaveCTurner 1
Releases(v8.5.3)

  • v8.5.3(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.3.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.8(Dec 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.8.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.2(Nov 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.1(Nov 15, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.5.0(Nov 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.5/release-notes-8.5.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.7(Oct 25, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.7.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.3(Oct 5, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.2(Sep 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.1(Aug 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.4.0(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.4/release-notes-8.4.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.6(Aug 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.6.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.3(Jul 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.2(Jul 7, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.1(Jun 30, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.3.0(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.3/release-notes-8.3.0.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.5(Jun 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.5.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.3(Jun 14, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.2(May 26, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.1(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.1.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.4(May 24, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.4.html

    Source code(tar.gz)
    Source code(zip)

  • v8.2.0(May 3, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.2/release-notes-8.2.0.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.3.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.3(Apr 20, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.3.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.2.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.2(Mar 31, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.2.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.1(Mar 22, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.1.0(Mar 8, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.1/release-notes-8.1.0.html

    Source code(tar.gz)
    Source code(zip)

  • v8.0.1(Mar 1, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.1.html

    Source code(tar.gz)
    Source code(zip)

  • v7.17.1(Feb 28, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/7.17/release-notes-7.17.1.html

    Source code(tar.gz)
    Source code(zip)

  • v8.0.0(Feb 10, 2022)

    Downloads: https://elastic.co/downloads/elasticsearch Release notes: https://www.elastic.co/guide/en/elasticsearch/reference/8.0/release-notes-8.0.0.html

    Source code(tar.gz)
    Source code(zip)
Owner
elastic
elastic
GitHub Repository https://www.elastic.co/products/elasticsearch
Python script for finding duplicate images within a folder.

Python script for finding duplicate images within a folder.

194 Dec 31, 2022
Reverse-ikea-image-search - A simple image of ikea search using jina.ai

IKEA Reverse Image Search This is a demo project to fetch ikea product images(IK

SOUVIK GHOSH 4 Mar 08, 2022
Es-schema - Common Data Schemas for Elasticsearch

Common Data Schemas for Elasticsearch The Common Data Schema for Elasticsearch i

Tim Schnell 2 Jan 25, 2022
A Python web searcher library with different search engines

Robert A simple Python web searcher library with different search engines. Install pip install roberthelper Usage from robert import GoogleSearcher

1 Dec 23, 2021
Modular search for Django

Haystack Author: Daniel Lindsley Date: 2013/07/28 Haystack provides modular search for Django. It features a unified, familiar API that allows you to

Haystack Search 3.4k Jan 04, 2023
esguard provides a Python decorator that waits for processing while monitoring the load of Elasticsearch.

esguard esguard provides a Python decorator that waits for processing while monitoring the load of Elasticsearch. Quick Start You need to launch elast

po3rin 5 Dec 08, 2021
A simple tool for searching images inside a local folder with text/image input using CLIP

clip-search (WIP) A simple tool for searching images inside a local folder with text/image input using CLIP 10 results for "a blonde woman" in a folde

5 Dec 25, 2022
TG-searcherBot - Search any channel/chat from keyword

TG-searcherBot Search any channel/chat from keyword. Commands /start - Starts th

TechiError 12 Nov 04, 2022
Full-text multi-table search application for Django. Easy to install and use, with good performance.

django-watson django-watson is a fast multi-model full-text search plugin for Django. It is easy to install and use, and provides high quality search

Dave Hall 1.1k Jan 03, 2023
A simple search engine that allow searching for chess games

A simple search engine that allow searching for chess games based on queries about opening names & opening moves. Built with Python 3.10 and python-chess.

Tyler Hoang 1 Jun 17, 2022
Pythonic search engine based on PyLucene.

Lupyne is a search engine based on PyLucene, the Python extension for accessing Java Lucene. Lucene is a relatively low-level toolkit, and PyLucene wr

A. Coady 83 Jan 02, 2023
Pysolr — Python Solr client

pysolr pysolr is a lightweight Python client for Apache Solr. It provides an interface that queries the server and returns results based on the query.

Haystack Search 626 Dec 01, 2022
document organizer with tags and full-text-search, in a simple and clean sqlite3 schema

document organizer with tags and full-text-search, in a simple and clean sqlite3 schema

Manos Pitsidianakis 152 Oct 29, 2022
Eland is a Python Elasticsearch client for exploring and analyzing data in Elasticsearch with a familiar Pandas-compatible API.

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

elastic 463 Dec 30, 2022
Home for Elasticsearch examples available to everyone. It's a great way to get started.

Introduction This is a collection of examples to help you get familiar with the Elastic Stack. Each example folder includes a README with detailed ins

elastic 2.5k Jan 03, 2023
Google Drive file searcher

Google Drive file searcher

Hafitz Setya 25 Dec 09, 2022
A sphinx extension for designing beautiful, screen-size responsive web components.

sphinx-design A sphinx extension for designing beautiful, view size responsive web components. Created with inspiration from Bootstrap (v5), Material

Executable Books 109 Jan 01, 2023
cve-search - a tool to perform local searches for known vulnerabilities

cve-search cve-search is a tool to import CVE (Common Vulnerabilities and Exposures) and CPE (Common Platform Enumeration) into a MongoDB to facilitat

cve-search 2k Jan 01, 2023
ElasticSearch ODM (Object Document Mapper) for Python - pip install esengine

esengine - The Elasticsearch Object Document Mapper esengine is an ODM (Object Document Mapper) it maps Python classes in to Elasticsearch index/doc_t

SEEK International AI 109 Nov 22, 2022
txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

txtai executes machine-learning workflows to transform data and build AI-powered semantic search applications.

NeuML 3.1k Dec 31, 2022