Officers were called to an address in Haverfordwest last week.
A two year old child has tragically passed away in hospital today.
Two people have been arrested on suspicion of assault and neglect, and the investigation is ongoing.
Dyfed Powys Police has released a statement saying: "Our thoughts are with the family at this difficult time. The family are being supported by specialist trained officers."