Dillinger was robbing a bank (scene before the steam engine scene) and one of the banks forgot to take down their FDIC sign; which was not around during the depression. The FDIC came out after the depression.