Line chart

Emmarky 

One way or another I think you need to pivot your data.

This can be done with a Pivot Chart / Table or a formula.  The formula shown top-right is

= SUMIFS(Hit_Ratio, 
    Block_Size, block, 
    Cache_size, cache
  )

but fairly soon a function PIVOTBY should be coming out.

Emmarky 

Since you want the different cache sizes to be separate chart series, you need to layout the data differently, with a column for each cache size:

You can then create a line chart and bar chart (or column chart) from this range.

By default, Excel will treat Block Size as a series. To correct that, click on the chart, then click Select Data on the Chart Design tab of the ribbon.

Select Block Size, then click Edit.

Select the Series values range, and copy it (Ctrl+C).

Click Cancel, then click Remove.

Next, click Edit under Horizontal (Category) Axis Labels.

Clear the box, then paste (Ctrl+V).

Click OK to confirm.

See the attached demo.

Click OK, then select