Joe Oliver's move to the finance portfolio led to minor changes to the federal cabinet Wednesday, with the prime minister naming Greg Rickford as the new natural resources minister.

Oliver had suggested he would speak to reporters after his swearing-in, but instead said only a few words as he climbed into a waiting car.

Rickford, the MP for Kenora, Ont., moved to natural resources from minister of state for science and technology. He has also been parliamentary secretary to the minister of aboriginal affairs.

London West MP Ed Holder is replacing Rickford in the science and technology file.

Prime Minister Stephen Harper was at Rideau Hall for the swearing-in, for which no press release was issued. Harper was hidden from reporters and photographers as he entered and exited Rideau Hall.

Oliver, who is the MP for Eglinton-Lawrence and has been natural resources minister since he was elected in 2011, will replace Jim Flaherty now that Flaherty is stepping down from cabinet.