The first difference is the price. VOIP phones range from less than $100 to over $800 for a fully tricked out executive model.
Part of that difference is bells and whistles, just as the difference in analog phones. However much of the difference goes much deeper. There are huge differences in quality between inexpensive and not-inexpensive VOIP phones. If you’re selecting VOIP handsets, it pays to understand those differences.