PinnedMember-onlyFree Course on Vector Similarity Search and FaissEssentials for the future of machine learning — For the past few months I’ve been working with Pinecone on a series of articles and videos covering the essentials of vector similarity search. The course introduces the idea and theory behind vector search, how to implement several algorithms in plain Python, and how to implement everything we learn efficiently…Vector Search3 min readVector Search3 min read
Published in Towards Data Science·Jan 12Member-onlyTraining Sentence Transformers with Softmax LossHow the original sentence transformer (SBERT) was built — Search is entering a golden age. Thanks to “sentence embeddings” and specially trained models called“sentence transformers” we can now search for information using concepts rather than keyword matching. Unlocking a human-like information discovery process. This article will explore the training process of the first sentence transformer, sentence-BERT — more commonly…Semantic Search9 min readSemantic Search9 min read
Published in Towards Data Science·Jan 3Member-onlySentence Transformers: Meanings in DisguiseHow modern language models capture meaning — Transformers have wholly rebuilt the landscape of natural language processing (NLP). Before transformers, we had okay translation and language classification thanks to recurrent neural nets (RNNs) — their language comprehension was limited and led to many minor mistakes, and coherence over larger chunks of text was practically impossible. Since the…Vector Search12 min readVector Search12 min read
Published in Towards Data Science·Dec 23, 2022Member-onlyDense Vectors: Capturing Meaning with CodeThe technology behind Google, Netflix, Spotify, and many more explained — There is perhaps no greater contributor to the success of modern Natural Language Processing (NLP) technology than vector representations of language. The meteoric rise of NLP was ignited with the introduction of word2vec in 2013 [1]. Word2vec is one of the most iconic and earliest examples of dense vectors representing…Artificial Intelligence12 min readArtificial Intelligence12 min read
Published in Towards Data Science·Dec 19, 2022Member-onlyAdvanced Topic Modeling with BERTopicHow do we organize the world’s most unorganizable data? — Organizing mass amounts of unstructured text data is complicated. It is not designed to be understood by machines, and having humans process this abundance of data is wildly expensive and very slow. Fortunately, there is light at the end of the tunnel. More and more of this unstructured text is…Artificial Intelligence12 min readArtificial Intelligence12 min read
Published in Better Programming·Dec 2, 2022Member-onlyAn Introduction to Open Domain Question-AnsweringUnlocking the treasure trove of unstructured data with deep learning — Search is a crucial functionality in many applications and companies globally. Whether in manufacturing, finance, healthcare, or almost any other industry, organizations have vast internal information and document repositories. Unfortunately, the scale of many companies’ data means that the organization and accessibility of information can become incredibly inefficient. …Data Science10 min readData Science10 min read
Published in Better Programming·Nov 16, 2022Member-onlyFixing YouTube Search with OpenAI’s WhisperHow to use OpenAI’s Whisper for better speech-enabled (audio) search — OpenAI’s Whisper is a new state-of-the-art (SotA) model in speech-to-text. It can almost flawlessly transcribe speech across dozens of languages and even handle poor audio quality or excessive background noise. The domain of spoken word has always been somewhat out of reach for ML use cases. Whisper changes that for…Machine Learning7 min readMachine Learning7 min read
Published in Better Programming·Nov 5, 2022Member-onlyCreate a Natural Language Semantic Search to Find GIFsEnhancing GIF discovery using NLP and semantic search — Vector search powers some of the most popular services in the world. It serves your Google results, delivers the best podcasts on Spotify, and accounts for at least 35% of consumer purchases on Amazon [1][2]. In this article, we will use vector search applied to language, called semantic search, to…NLP6 min readNLP6 min read
Oct 12, 2022Member-onlyHow to Learn (A Lot)Learning doesn’t need to be so hard — The modern world rewards those that can learn and adapt quickly. Both financially and in your own personal fulfillment. Learning new skills keeps life interesting and fresh, but it isn’t easy to do. Continuous learning can fry your brain very quickly. …Self Improvement5 min readSelf Improvement5 min read
Published in Towards Data Science·Aug 11, 2022Member-onlyQuick-fire Guide to Multi-Modal ML With OpenAI’s CLIPLearn how to translate between text to image and back again with CLIP and vector embeddings — After a few short years of life, children can fathom the concepts behind simple words and connect them to related images. They can identify the connection between shapes and textures of the physical world to the abstract symbols of written language. It’s something we take for granted. Very few (if…Artificial Intelligence5 min readArtificial Intelligence5 min read
