To be fair, mass annihilation is crazy powerful and 1GJ for a random pebble is low efficiency.
You want to keep things balanced, but that's a bit difficult under the theme since plain water should be shreddable for nigh-unlimited power.
What if the annihilator was more like the nuclear reactor and had to run full tilt? As in, that piece of coal can provide 1GJ, but you have to catch/spend it in 0.5 seconds. IE: you'd need to let most of it go to waste, have huge accumulator banks, or a 2GW factory eating it.