Some things to try to build on this experiment:
Use the xbutil utility to query the board. Can you see which .xclbin file is loaded?
Again using xbutil, which kernel(s) are present in the FPGA? Do you see a difference before and after the FPGA is programmed?