Grow Function: Generate 3D Stacked Bifurcating Double Deep Cellular Automata based organisms which differentiate using a Genetic Algorithm...

Related tags

Deep LearningGrowF
Overview

GrowF

Banner

Grow Function: Generate 3D Stacked Bifurcating Double Deep Cellular Automata based organisms which differentiate using a Genetic Algorithm...

TLDR; High Def Living Trees that you can breed, trim and mint as NFTs on Solana, Ethereum, Cardano and other blockchain networks.

This demo represents the current state of the codebase. If anyone wishes to join this project, please contact or fork.

Written in Python using the Blender Library

Current state of development https://www.youtube.com/watch?v=BUarQzuhj1c

Installation

  • Install Blender if you don't already have it
  • Open treegen.blend

Once opened, you can generate whatever tree is currently there by default by going to the scripting tab, opening tree.py and pressing the Run button

The Metaverse Needs Trees

Let's Face it, it's hard to model trees that are realistic in any 3D modeling platform. Much less, make them lowpoly or high poly, or ready for video games or kinematics and physics. But if you think about it, it's hard to make believable trees because trees are grown, not sculpted by nature. They the results of a bunch of growth patterns that came together to form what we categorize as trees or even any type of plant. The bifurcation structure of a tree is everywhere. You needen't go as far as looking at the human nervous system, or in the structure of folders in your computer, to see that same tree organization. Imagine having a tree that you can plant on top of a structure like a stone sculpture in VR and watch it's roots eating through the walls and stone in hyper-real time. Imagine breeding trees to be a specific color or give a specific type of fruit, or growing them in zero gravity. Imagine planting a garden and watching your plants and trees grow together over time and generations.

We Have the Technology

Recent developments in the fields of Cellular Automata and Genetic Algorithms have led to the possibility of growing living organisms in higher dimensions. Many projects like Lenia, The Life Engine and even VR games like Playne, and Inward have made a big deal of living organisms in games and tech culture. These living organisms can behave like bacteria, like larger soft-bodied oganisms, or like Trees. On a scientific level, there exist virtual living ecosystems of over 500,000 plants in simulations like the ones seen in the paper "Synthetic Silviculture: Multi-Scale Modeling of Plant Ecosystems". These large or multi-scale simulations are focused on larger scale simulations, creating realistic, yet estimated details, (albeit through rigorous scientific analysis to approximate reality).

But that begs the question, how high definition can one go in creating growing 3D systems? Can cell differentiation be accquired by genetic algorithm in new and spontaneous ways which account for ecosystem? This project aims to advance toward answering those questions, starting with what we think will end up being hi-res tree models, but could end up as anything.

I think it's possible to go to infinite resolution by making a growth protocol that is forward compatible, so that the computers of the future which operate on orders of magnitude of higher parallelism can show the same tree you minted in 2022, in much higher detail.

The Blockchain? Why?

Well, trees, and other living virtual organisms can be owned. The 3D Models of their life progression can be included in games using Non-Fungible Tokens (NFTs). If you can own any unique digital item, why not own a tree that you have bred, or trimmed, or simply that you found in a VR game somewhere. Think about trimming, or when trees bear fruits that have specific properties or visual peculiarities. Each branch of the tree can be removed, the fruits or leaves, (or whatever ends up growing on a bifurcation) can be separated from the tree, recorded as removed in the tree's history (affecting it's model forever). Just like with real trees, the seeds in those fruits can be minted and given to friends or sold, reflecting the value that you have added to the tree by planting and growing it somewhere in the Metaverse. It could end up seeding virtual forests, or being used as CG set pieces in movies or video games depending on who buys it from you.

Owner
Nathaniel Gibson
Nathaniel Gibson
This repository holds code and data for our PETS'22 article 'From "Onion Not Found" to Guard Discovery'.

From "Onion Not Found" to Guard Discovery (PETS'22) This repository holds the code and data for our PETS'22 paper titled 'From "Onion Not Found" to Gu

Lennart Oldenburg 3 May 04, 2022
PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and Multi-Step Knowledge Distillation

PocketNet This is the official repository of the paper: PocketNet: Extreme Lightweight Face Recognition Network using Neural Architecture Search and M

Fadi Boutros 40 Dec 22, 2022
RL and distillation in CARLA using a factorized world model

World on Rails Learning to drive from a world on rails Dian Chen, Vladlen Koltun, Philipp Krähenbühl, arXiv techical report (arXiv 2105.00636) This re

Dian Chen 131 Dec 16, 2022
EFENet: Reference-based Video Super-Resolution with Enhanced Flow Estimation

EFENet EFENet: Reference-based Video Super-Resolution with Enhanced Flow Estimation Code is a bit messy now. I woud clean up soon. For training the EF

Yaping Zhao 19 Nov 05, 2022
Interactive Image Generation via Generative Adversarial Networks

iGAN: Interactive Image Generation via Generative Adversarial Networks Project | Youtube | Paper Recent projects: [pix2pix]: Torch implementation for

Jun-Yan Zhu 3.9k Dec 23, 2022
CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes (AAAI2022)

CMUA-Watermark The official code for CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes (AAAI2022) arxiv. It is bas

50 Nov 26, 2022
[IEEE TPAMI21] MobileSal: Extremely Efficient RGB-D Salient Object Detection [PyTorch & Jittor]

MobileSal IEEE TPAMI 2021: MobileSal: Extremely Efficient RGB-D Salient Object Detection This repository contains full training & testing code, and pr

Yu-Huan Wu 52 Jan 06, 2023
EigenGAN Tensorflow, EigenGAN: Layer-Wise Eigen-Learning for GANs

Gender Bangs Body Side Pose (Yaw) Lighting Smile Face Shape Lipstick Color Painting Style Pose (Yaw) Pose (Pitch) Zoom & Rotate Flush & Eye Color Mout

Zhenliang He 321 Dec 01, 2022
This is a Pytorch implementation of the paper: Self-Supervised Graph Transformer on Large-Scale Molecular Data.

This is a Pytorch implementation of the paper: Self-Supervised Graph Transformer on Large-Scale Molecular Data.

212 Dec 25, 2022
Demos of essentia classifiers hosted on replicate.ai

essentia-replicate-demos Demos of Essentia models hosted on replicate.ai's MTG site. The models Check our site for a complete list of the models avail

Music Technology Group - Universitat Pompeu Fabra 12 Nov 14, 2022
Repository accompanying the "Sign Pose-based Transformer for Word-level Sign Language Recognition" paper

by Matyáš Boháček and Marek Hrúz, University of West Bohemia Should you have any questions or inquiries, feel free to contact us here. Repository acco

Matyáš Boháček 30 Dec 30, 2022
PSPNet in Chainer

PSPNet This is an unofficial implementation of Pyramid Scene Parsing Network (PSPNet) in Chainer. Training Requirement Python 3.4.4+ Chainer 3.0.0b1+

Shunta Saito 76 Dec 12, 2022
code for "Self-supervised edge features for improved Graph Neural Network training",

Self-supervised edge features for improved Graph Neural Network training Data availability: Here is a link to the raw data for the organoids dataset.

Neal Ravindra 23 Dec 02, 2022
Global Rhythm Style Transfer Without Text Transcriptions

Global Prosody Style Transfer Without Text Transcriptions This repository provides a PyTorch implementation of AutoPST, which enables unsupervised glo

Kaizhi Qian 193 Dec 30, 2022
Lacmus is a cross-platform application that helps to find people who are lost in the forest using computer vision and neural networks.

lacmus The program for searching through photos from the air of lost people in the forest using Retina Net neural nwtwork. The project is being develo

Lacmus Foundation 168 Dec 27, 2022
这是一个mobilenet-yolov4-lite的库,把yolov4主干网络修改成了mobilenet,修改了Panet的卷积组成,使参数量大幅度缩小。

YOLOV4:You Only Look Once目标检测模型-修改mobilenet系列主干网络-在Keras当中的实现 2021年2月8日更新: 加入letterbox_image的选项,关闭letterbox_image后网络的map一般可以得到提升。

Bubbliiiing 65 Dec 01, 2022
This repository contains the code for TACL2021 paper: SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization

SummaC: Summary Consistency Detection This repository contains the code for TACL2021 paper: SummaC: Re-Visiting NLI-based Models for Inconsistency Det

Philippe Laban 24 Jan 03, 2023
[CVPR 2022 Oral] EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimation

EPro-PnP EPro-PnP: Generalized End-to-End Probabilistic Perspective-n-Points for Monocular Object Pose Estimation In CVPR 2022 (Oral). [paper] Hanshen

同济大学智能汽车研究所综合感知研究组 ( Comprehensive Perception Research Group under Institute of Intelligent Vehicles, School of Automotive Studies, Tongji University) 842 Jan 04, 2023
Council-GAN - Implementation for our paper Breaking the Cycle - Colleagues are all you need (CVPR 2020)

Council-GAN Implementation of our paper Breaking the Cycle - Colleagues are all you need (CVPR 2020) Paper Ori Nizan , Ayellet Tal, Breaking the Cycle

ori nizan 260 Nov 16, 2022
Relative Positional Encoding for Transformers with Linear Complexity

Stochastic Positional Encoding (SPE) This is the source code repository for the ICML 2021 paper Relative Positional Encoding for Transformers with Lin

Antoine Liutkus 48 Nov 16, 2022