"I spoke to the chairman this morning," Jepson said after the Gills' 1-0 victory over Crewe on Saturday.
"Huddersfield have made contact with him, but he doesn't want to give them permission to speak to me.
"As far as I am concerned, I am the Gillingham manager and will be - and I haven't got any problems with that."