There is a way to do this with error bars, and that's described in some detail on Peltier's Excel page.
BUT, if you really want to have the kind of control over formatting that you show in your example, you really need to make each bar a separate series. To do that, you have to format your data table like this:
If all that "wasted" space is a problem, you can hide this table or move it somewhere. The benefit of organizing the data this way is shown in the graph below.
To get the series to be vertical bars, each data point has to have the same x-value, hence the repetition in the first column. Once the table is organized, select all the data and choose Straight Lined Scatter from the Graph tab.
You'll get something like the picture below. I think I chose "Marked Lined Scatter", which is why the data markers show. I've formatted the first series to have arrowheads, which you can get under Format Data Series > Line > Weights and Arrows.
Hope this helps and good luck.