Unfortunately, this is not one of the options for a built-in function, such as pd.fillna().
Change: Thanks for the fix. Apparently this is possible, as shown in @Vaishali's answer.
However, you can first set the data subframe to missing values, and then apply the map with your dictionary.
df.loc[df['B'].isnull(), 'B'] = df['A'].map(dict)