A fluid medium for storing, relating, and surfacing thoughts.

Overview

Conceptarium

A fluid medium for storing, relating, and surfacing thoughts. Read more...

Instructions

The conceptarium takes up about 1GB RAM when running. Clone the repository, and install the requirements using:

python3 -m pip install -r requirements.txt

Note: If you plan to deploy your conceptarium on a Raspberry Pi 4, you'll need a version of pytorch compiled for ARM devices, such as pytorch-rpi.

Start the web server using:

python3 -m uvicorn main:app --reload

This will make your conceptarium available at 127.0.0.1:8000. Go to 127.0.0.1:8000/docs to get an overview of the available endpoints, and read the architecture section of the write-up.

Note: If you want to access your conceptarium remotely, have a look at ngrok.

Simple ways of getting the most out of your conceptarium are by configuring adding it as a search engine via browser extensions, or by creating some AutoKey / AutoHotKey scripts to interact with it via hotkeys.

Comments
  • Installation on Raspberry Pi OS?

    Installation on Raspberry Pi OS?

    I'd first tried to install the conceptarium on the preinstalled 32-bit Pi OS, which failed because I could not get Streamlit to run.

    Then I've tried it with the new 64-bit version of Pi OS. Streamlit works now, but the Pytorch-version linked in the readme could not be installed.

    Have you managed to install the conceptarium on Raspberry Pi OS? If not, which OS have you been using, so that I can try that out?

    opened by phkus 7
  • Unable to access conceptarium via the API

    Unable to access conceptarium via the API

    I've installed it via Docker and entered a token at localhost:8501. But I can't access it through the Curl or Request URL provided in the docs. Check custodian results in "{"custodian":false,"authorized_microverse":[]} and /save in "Only the conceptarium's custodian can save thoughts in it."

    One thing that came to mind: I've used special characters in the token. Could the issue be with the URL encoding?

    opened by phkus 7
  • Help in installation

    Help in installation

    Hi, I'm someone from a non-coding background so I have some difficulties following the instructions in the installation guide. Can you elaborate more on the installation guide (a step-by-step installation procedure would be great) in readme so that individuals from non-technical backgrounds can also make use of this wonderful resource.

    Additionally can you explain how I can self-host this application using a salvaged desktop?

    opened by Nomad-of-Ouroboros 6
  • Unable to search for thoughts

    Unable to search for thoughts

    Unfortunately I have to open another issue, but we're getting there.

    • my token works now
    • I can save thoughts, or at least I get a response with a filename, metadata, and the embeddings

    However, I cannot query for those thoughts. Through the API I just get an internal server error, but through the interface there are more details:

    JSONDecodeError: Expecting value: line 1 column 1 (char 0) Traceback: File "/usr/local/lib/python3.9/site-packages/streamlit/script_runner.py", line 379, in _run_script exec(code, module.dict) File "/app/main.py", line 19, in component.paint() File "/app/components/navigator.py", line 25, in paint st.session_state['authorized_thoughts'] = knowledge.load( File "/app/components/knowledge.py", line 45, in load content = json.loads(response.content) File "/usr/local/lib/python3.9/json/init.py", line 346, in loads return _default_decoder.decode(s) File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None

    opened by phkus 5
  • Where is the docker data stored?

    Where is the docker data stored?

    Hey @paulbricman - really neat work! I'm deploying the conceptarium, ideoscope and lexiscore in docker via docker-compose.

    Quick question: where is the core data stored?

    I'd like to add a volume mount my config so that I can take backups of the data. I looked at the source code and saw the metadata pickle, but this seems to live in /app.

    opened by issmirnov 5
  • Knowledge folder not created when installed from source

    Knowledge folder not created when installed from source

    My imported knowledge folder should have gone into the base conceptarium directory, not the main user folder as was the case with the Docker version.

    Still: Shouldn't it have created such a folder for me when I first try to log in?

    Based on #25

    bug 
    opened by paulbricman 3
  • probem with Docker installation

    probem with Docker installation

    I've installed the new version of the conceptarium on MacOS following the Docker approach. During the installation there were no errors, but now I cannot get the Docker image to run.

    The frontend image exits immediately after starting it, with the following error in the log: Error: Invalid value: File does not exist: main.py Usage: streamlit run [OPTIONS] TARGET [ARGS]... Try 'streamlit run --help' for help.

    The backend image does show as "Running", but looking at the log there is also an error: INFO: Will watch for changes in these directories: ['/app'] INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: Started reloader process [8] using watchgod ERROR: Error loading ASGI app. Could not import module "main".

    opened by phkus 2
  • Docker deployment of conceptarium_frontend

    Docker deployment of conceptarium_frontend

    While deploying with the docker-compose up -d command, I get the following error in the conceptarium_frontend container.

    AttributeError: module 'click' has no attribute 'get_os_args'

    It is resolved by adding 'click' in frontend/requirements.txt

    opened by Trajjan 1
  • Online demo instance showing error - No such file or directory: components

    Online demo instance showing error - No such file or directory: components

    Your online instance hosted on Hugging Face is currently facing an issue, the one you link from your blog:

    FileNotFoundError: [Errno 2] No such file or directory: 'components'
    Traceback:
    
    File "/home/user/.local/lib/python3.8/site-packages/streamlit/script_runner.py", line 354, in _run_script
        exec(code, module.__dict__)
    File "/home/user/app/frontend/main.py", line 12, in <module>
        microverses.paint()
    File "frontend/components/microverses.py", line 24, in paint
        components = [e.split('.')[0] for e in os.listdir('components') if e.endswith(
    

    Unrelated, but thank you for the interesting write-ups!

    opened by NumesSanguis 1
  • API docs now incomplete

    API docs now incomplete

    Since you've changed the way the authorization works, the automatically generated API requests at localhost:8000/docs are not correct, because the token is not included anywhere in the output. After some trial and error, I've found out what works now (add -H 'authorization: Bearer <token>'\ to the curl request), but this might be an issue for someone just trying it out and relying on the requests provided by the docs.

    opened by phkus 1
  • Consider using state of the art semantic similarity algorithms

    Consider using state of the art semantic similarity algorithms

    The state of the art can be found here: https://paperswithcode.com/sota/semantic-textual-similarity-on-sts-benchmark

    Other benchmarcks: https://paperswithcode.com/task/semantic-textual-similarity

    opened by LifeIsStrange 1
  • Batch import via adding notes in knowledge folder

    Batch import via adding notes in knowledge folder

    I'm now curious how to save these notes. I was initially assuming that all text files in the knowledge folder would show up as notes here, but it seems at least the note I placed there is not showing, again I'm sure I'm doing something wrong.

    enhancement 
    opened by paulbricman 0
Releases(v2.0.0)
Owner
An open collective on a mission to augment thought for all.
This is friendlist update tools & old idz clon & follower idz clon etc

This is friendlist update tools & old idz clon & follower idz clon etc

MAHADI HASAN AFRIDI 1 Jan 15, 2022
🤞 Website-Survival-Detection

- 🤞 Website-Survival-Detection It can help you to detect the survival status of the website in batches and return the status code! - 📜 Instructions

B0kd1 4 Nov 14, 2022
List of all D&D 5e monsters: WotC + popular third-party sourcebooks

Xio's Guide to Monsters If you're a DM like me, and you have multiple sources of D&D 5e monsters that include WotC as well as third-party suppliers, y

20 Jan 06, 2023
Python framework to build apps with the GASP metaphor

Gaspium Python framework to build apps with the GASP metaphor This project is part of the Pyrustic Open Ecosystem. Installation | Documentation | Late

5 Jan 01, 2023
OB_Template is a vault template reference for using Obsidian.

Obsidian Template OB_Template is a vault template reference for using Obsidian. If you've tested out Obsidian. and worked through the "Obsidian Help"

323 Dec 27, 2022
Ergonomic option parser on top of dataclasses, inspired by structopt.

oppapī Ergonomic option parser on top of dataclasses, inspired by structopt. Usage from typing import Optional from oppapi import from_args, oppapi @

yukinarit 4 Jul 19, 2022
The purpose is to have a fairly simple python assignment that introduces the basic features and tools of python

This repository contains the code for the python introduction lab. The purpose is to have a fairly simple python assignment that introduces the basic

1 Jan 24, 2022
My tools box script for sigma

sigma_python_toolbox My tools box script for sigma purpose My goal is not to replace sigma but to put at disposal the scripts that I think to help me

4 Jun 20, 2022
HSPICE can not perform Monte Carlo (MC) simulations while considering aging effects

HSPICE can not perform Monte Carlo (MC) simulations while considering aging effects. I developed a python wrapper that automatically performs MC and aging simulations using HPSICE to save engineering

Habib Kazemi 2 Nov 22, 2021
Runs macOS on linux with qemu.

mac-on-linux-with-qemu Runs macOS on linux with qemu. Pre-requisites qemu-system-x86_64 dmg2img pulseaudio python[click] Usage After cloning the repos

Arindam Das 177 Dec 26, 2022
A minimalist personal blogging system that natively supports Markdown, LaTeX, and code highlighting.

December Welcome to the December blogging system's code repository! Introduction December is a minimalist personal blogging system that natively suppo

TriNitroTofu 10 Dec 05, 2022
Werkzeug has a debug console that requires a pin. It's possible to bypass this with an LFI vulnerability or use it as a local privilege escalation vector.

Werkzeug Debug Console Pin Bypass Werkzeug has a debug console that requires a pin by default. It's possible to bypass this with an LFI vulnerability

Wyatt Dahlenburg 23 Dec 17, 2022
Unofficial Python implementation of the DNMF overlapping community detection algorithm

DNMF Unofficial Python implementation of the Discrete Non-negative Matrix Factorization (DNMF) overlapping community detection algorithm Paper Ye, Fan

Andrej Janchevski 3 Nov 30, 2021
An end-to-end encrypted chat

An end-to-end encrypted chat, that allows users to anonymously talk without ip logs, personal info, or need for registration.

Privalise 1 Nov 27, 2021
京东自动入会获取京豆

京东入会领京豆 要求 有一定的电脑知识 or 有耐心爱折腾 需要Chrome(推荐)、Edge(Chromium)、Firefox 操作系统需是Mac(本人没在m1上测试)、Linux(在deepin上测试过)、Windows 安装方法 脚本采用Selenium遍历京东入会有礼界面,由于遍历了200

Vanke Anton 500 Dec 22, 2022
Your copilot to studies and work (Pomodoro-timer, Translate and Notes app)

Copylot Your copilot to studies and work (Pomodoro-timer, Translate and Notes app) Copylot are three applications in one: Pomodoro Translate Notes Cop

Eduardo Mendes 20 Dec 16, 2022
The only purpose of a byte-sized application is to help you create .desktop entry files for downloaded applications.

Turtle 🐢 The only purpose of a byte-sized application is to help you create .desktop entry files for downloaded applications. As of usual with elemen

TenderOwl 14 Dec 29, 2022
Dotfiles for my configurations!

Dotfiles Repo Welcome! Over here, you can find my dotfiles for various applications, including QTile, Alacritty, Kitty, LunarVim, and more! Make sure

class PythonAddict 3 Jan 10, 2022
Cloud-native SIEM for intelligent security analytics for your entire enterprise.

Microsoft Sentinel Welcome to the Microsoft Sentinel repository! This repository contains out of the box detections, exploration queries, hunting quer

Microsoft Azure 2.9k Jan 02, 2023
With the initiation of the COVID vaccination drive across India for all individuals above the age of 18, I wrote a python script which alerts the user regarding open slots in the vicinity!

cowin_notifier With the initiation of the COVID vaccination drive across India for all individuals above the age of 18, I wrote a python script which

13 Aug 01, 2021