Flexible LLM Choice
One of the most important considerations is the AI assistant's flexibility in terms of Large Language Models (LLMs).
Ideally, you want an assistant that allows you to choose from a variety of LLMs, rather than being locked into a single model from one company, such as OpenAI. Having the freedom to experiment with different LLMs, such as Anthropic's Claude or others, allows you to find the best fit for your specific coding tasks and preferences.
This flexibility also ensures that you can take advantage of the latest advancements in AI technology, as new and improved LLMs are constantly being developed. You will want to make sure the assistant fits your needs, as different language models excel in different areas.
Free vs. Paid
Many AI coding assistants offer a free tier, which can be a good way to test out the tool and see if it meets your needs. However, free tiers often come with limitations, such as reduced features or usage limits. These assistants can quickly become frustrating.
While they are useful for marketing, they tend not to have the best practical usage for the real world. If you find yourself hitting these limitations, consider upgrading to a paid subscription for a more complete and productive experience.
Instead of aiming for the free tier, consider jumping between the free trials offered by several assistants. That way, you get to sample a few different assistants for free until you decide which is best for you. Paid subscriptions for AI coding assistants typically range from $9 to $20 per month, which is not a big deal for most people, especially considering the increased productivity and efficiency they offer.
Codebase Awareness
For more complex projects, it's essential to choose an AI assistant that is codebase-aware. This means that the assistant can analyze your entire project and understand the relationships between different files and code modules. Codebase awareness allows the AI assistant to provide more accurate and Relevant code suggestions, as it can take into account the specific context of your project. Most assistants have this feature available, so find one that helps you view multiple files.
You might also find yourself coding in a specific topic or subject area, so find assistants that can assist with those specific requests. This contextual understanding leads to faster coding and more useful suggestions.
Privacy and Security
When choosing an AI coding assistant, it's crucial to consider your privacy and security needs. Some AI assistants may Collect and store your code data, which could raise concerns about intellectual property and data breaches. If you're working on sensitive or proprietary projects, look for AI assistants that offer strong privacy protections and data encryption.
It is also helpful to discuss this topic with an IT department if you work for a big company.
The safety may be just fine, however, if you are working on something that will one day be a startup or big company, you may need to protect this code base.
Run AI Locally
If you have a high-end PC with a powerful graphics card, you might consider running AI models locally. This offers greater control over your data and eliminates the need to share your code with external servers. The VRAM requirements are important to check before you begin using the assistant:
-
See the total VRAM in your graphic card.
-
Go to the AI's website, such as Ollama and Continue.
-
Figure out the space requirements and make sure you have the space necessary for the AI models.
Local execution is good for more powerful machines, as it improves data privacy.