This is easy to do with JS Vanilla.
var nonMatchingItems = response.filter(function (item) { return arrayOfIDs.indexOf(item.id) === -1; });
The same approach is possible with lodash _.filter() if you should positively use lodash.
ES6 version above:
var nonMatchingItems = response.filter(item => arrayOfIDs.indexOf(item.id) === -1);
source share