Search for a command to run...
Widely known as fotiecodes, an open source enthusiast, software developer, mentor and SaaS founder. I'm passionate about creating software solutions that are scalable and accessible to all, and i am dedicated to building innovative SaaS products that empower businesses to work smarter, not harder.
No comments yet. Be the first to comment.
Lisbon, If you have ever been here, you know the streets are a wild mix of steep hills, narrow cobblestone alleys, and confusing one-way roads. Navigating this city takes serious skill. The yellow tra
If you have been paying attention to the AI space for the last few months, you know the fatigue is real. We have spent three years typing into a box, getting a paragraph of text back, copying it, past
I have always wondered how Apple does their spatial photos on iOS and especially on the new Apple Vision Pro. If you have tried the headset, or even just tilted your phone while looking at a "spatial" capture, you know that weird, distinct feeling of...
Understand the distinctions between Retrieval and Cache-Augmented Generation; find out how CAG improves speed while RAG handles real-time information
I’m sitting here with a hot cup of coffee, about halfway through Google’s new paper on "Nested Learning," and I have to be honest: I need to get this out of my head and onto the screen. Usually, when a big lab drops a paper, I skim the abstract, nod ...
Words are very powerful! To help people understand us, we use them to communicate our ideas and thoughts. The funny thing is, although humans understand words, AI models don't actually understand them. All they understand are numbers! Thus, we need to help them by converting words into numerical values for them to grasp. Imagine a situation whereby we assigned a random number to every word, For example:
"Apple" = 5
"Banana" = 12
"Cat" = 8
Now, if we want to teach the model about a sentence like "I love apples," we could change it to numbers:
The model sees those numbers and knows, "Oh, 5 means 'apple'!"
However, it isn't really useful to merely provide random numbers. It sounds like we're communicating in a secret code that only we know. Thus, we use a more effective method of converting words into numbers that make sense to the model.
That's where embeddings come in! We use clever techniques to assign numbers to words based on their usage, as opposed to assigning random numbers. For instance, "apple" and "banana" may have similar numbers if they are often used in sentences together. Thus, much as humans pick up new words by seeing them in sentences, the model picks up new words by seeing the words that surround them.
We refer to these unique numbers as embeddings, and they allow the model to start understanding words and even predicting words that could appear in a phrase! Therefore, for a model to understand us and for us to teach it something new, we have to convert our words into numbers, which is the language the model understands.