You can do this with stem, by pointing it 'Marker'as an up arrow ...
% Open figure
figure;
% Blue stem plot at x=0, to y=75. Marker style is up arrow
stem(0, 75,'color','b','linewidth',2,'marker','^')
% Add infinity label at x=0, y = 82 = 75 + fontsize/2, where we plotted up to 75
text(0,82,'∞','FontSize',14)
% Set axes limits
xlim([-40,40])
ylim([0,90])
You can see the graph here, but see the change below for the improved version.
Please note, of course, you must choose a y value that is large compared to any other data on the chart. In this example, I chose 75 to get closer to your desired example. MATLAB cannot construct a value in inf, because, well, where does infinity sit on the y axis?
: , y '≈', . xlim ylim axis y, , :
stem(0, 80,'color','b','linewidth',2,'marker','^')
text([-42,0,38], [80,87,80], {'≈','∞','≈'}, 'Fontsize', 14)
axis([-40, 40, 0, 100])
yticks(0:20:60)
