Raid Points are the amount of Resources you carried off during Raids minus the amount of Resources carried off from your Castle by raiders. If you have fewer Raid Ranking Points than, let's say, one day ago, this means that more Resources were taken from you than you plundered from other Castles.