A father is on trial accused of subjecting his newborn to "excessive and severe" shaking when she was just five weeks old.