#

multi-modal

Here are 117 public repositories matching this topic...

lucidrains / DALLE-pytorch

Sponsor

Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch

deep-learning transformers artificial-intelligence multi-modal attention-mechanism text-to-image

Updated Jul 6, 2022
Python

valhalla / valhalla

Open Source Routing Engine for OpenStreetMap

directions openstreetmap routing astar traveling-salesman dijkstra routing-engine isochrones multi-modal tiled

Updated Feb 20, 2023
C++

marqo

marqo-ai / marqo

Tensor search for humans.

Updated Feb 20, 2023
Python

docarray

docarray / docarray

🧬 The data structure for multimodal data · Neural Search · Vector Search · Document Store

graphql elasticsearch deep-learning protobuf sqlite data-structures nearest-neighbor-search cross-modal multi-modal semantic-search unstructured-data multimodal nested-data weaviate dataclass vector-search neural-search qdrant docarray

Updated Feb 20, 2023
Python

zjunlp / DeepKE

An Open Toolkit for Knowledge Graph Extraction and Construction published at EMNLP2022 System Demonstrations.

Updated Feb 19, 2023
Python

DirtyHarryLYL / Transformer-in-Vision

Recent Transformer-based CV and related works.

computer-vision deep-learning paper transformer visual-language multi-modal self-attention vision-transformers

Updated Feb 20, 2023

OFA-Sys / Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.

nlp computer-vision deep-learning transformers pytorch chinese pretrained-models multi-modal clip contrastive-loss vision-language multi-modal-learning image-text-retrieval vision-and-language-pre-training

Updated Feb 20, 2023
Python

MedMNIST

MedMNIST / MedMNIST

18 MNIST-like Datasets for 2D and 3D Biomedical Image Classification: pip install medmnist

benchmark machine-learning deep-learning pytorch medical dataset medical-imaging mnist classification medical-image-computing multi-modal 3d 2d automl decathlon medical-image-analysis few-shot-learning medmnist

Updated Jan 30, 2023
Python

modelscope

modelscope / modelscope

ModelScope: bring the notion of Model-as-a-Service to life.

python nlp science machine-learning deep-learning cv speech multi-modal

Updated Feb 20, 2023
Python

jokieleung / awesome-visual-question-answering

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

vqa awesome-list multi-modal multi-modal-learning attention-networks

Updated Feb 9, 2023

farmvibes-ai

microsoft / farmvibes-ai

FarmVibes.AI: Multi-Modal GeoSpatial ML Models for Agriculture and Sustainability

weather sustainability ai agriculture geospatial remote-sensing multi-modal geospatial-analytics stac

Updated Feb 17, 2023
Jupyter Notebook

boschresearch / OASIS

Official implementation of the paper "You Only Need Adversarial Supervision for Semantic Image Synthesis" (ICLR 2021)

machine-learning computer-vision deep-learning pytorch gan image-generation multi-modal generative-adversarial-networks oasis image-to-image-translation bcai semantic-image-synthesis iclr2021 label-to-image-translation

Updated Nov 8, 2022
Python

EndlessSora / TSIT

[ECCV 2020 Spotlight] A Simple and Versatile Framework for Image-to-Image Translation

generative-adversarial-network gan style-transfer image-manipulation image-generation versatile multi-modal feature-transformation image-to-image-translation multi-scale two-stream-networks semantic-image-synthesis eccv2020

Updated Nov 28, 2021
Python

v-iashin / SpecVQGAN

Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)

audio video pytorch transformer gan multi-modal evaluation-metrics video-understanding vas video-features vqvae bmvc melgan audio-generation vggsound

Updated Jun 12, 2022
Jupyter Notebook

tangxyw / RecSysPapers

推荐/广告/搜索领域工业界经典以及最前沿论文集合。A collection of industry classics and cutting-edge papers in the field of recommendation/advertising/search.

Updated Feb 20, 2023
Python

JuliaRobotics / Caesar.jl

Robust robotic localization and mapping, together with www.NavAbility.io. Reach out to info@navability.io for help.

database robotics julia caesar isam slam multi-modal parametric-navigation-solutions non-parametric

Updated Feb 19, 2023
Julia

junchen14 / Multi-Modal-Transformer

The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and self-supervised learning models. Additionally, it also collects many useful tutorials and tools in these related domains.

language multi-modal image-transformer vision-transformer video-language efficiency-transformer video-transformer mlp-mixer transformer-readling-list multi-modal-cvpr2021

Updated Aug 27, 2022

moabarar / nemar

[CVPR2020] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation

deep-learning cnn pytorch multi-modal image-registration affine-transformation stn image-to-image-translation multimodal deformable-transformation multi-modal-learning cvpr2020 registartion multimodal-image-registration

Updated Aug 2, 2020
Python

RUCAIBox / PLMPapers

A paper list of pre-trained language models (PLMs).

multilingual machine-learning natural-language-processing deep-learning gpt representation-learning multi-modal bert pre-training

Updated Nov 30, 2021

v-iashin / MDVC

PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)

audio visual speech pytorch transformer multi-modal i3d dense-video-captioning activitynet-captions cvpr-workshop

Updated May 31, 2021
Python

Improve this page

Add a description, image, and links to the multi-modal topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multi-modal topic, visit your repo's landing page and select "manage topics."