This type of caliper needs a special tool to get the piston to retract, these can’t just be pushed back in, they have to be twisted in. If the piston isn’t falling out of the caliper and there isn’t any fluid seeping around the piston then you might be okay, most auto parts stores have the tool you need to twist it back in for rent.