If you want to fully support the large number of devices which can be supported, you'll want to use the plugin.
The current level of support for indexedDb cab be found here. The gist of it is that Android 4.3 and below does not support indexedDb, and iOS only partially supports it. The cordova plugin polyfills these gaps by utilizing webSql transparently if indexedDb is not present.