If you're talking D20 Ravenloft/Masque, i'm rather fond of the Incantations from Unearthed Arcana(3rd ed.) In theory, anyone can use a Ritual to cast a spell-in practice, it's nearly impossible. DM's make whatever spells they like, using a simple formula of Effects, then reduce the DC to possible levels with Casting times and special requirements,assign Backlash(the consequences of failure) and Voila! A Ritual enters the Mists...
Ritual DC's can be pretty high-25 to 40 or more. Spellcraft is usually added to the roll(Forbidden Lore in Masque might be more suitable).
I ran a D20 Lite campaign last year-a condensation of the Shadowslayers Minigame in Polyhedron-and replaced all Spells with Incantations.For the rare quick effect, a PC could use a Craft Skill with a Craft Item feat(I rolled Rings, Wands etc. into this) Craft Potion or Scribe Scroll...The PC began the Ritual, spent the expensive ingredients and risked his/her health and sanity, and if the dice were kind the party now had a 1-shot Magic Item of relative potency. Magic was rarely called upon by the PC's-but made a huge impact when it was.
For a little less work, try the Spellbook in Call of Cthulu D20-nice effects, but most spells cause both Ability Damage and Sanity loss. Since you probably aren't using Sanity in RL, try a sliding DR for Horror Checks(and a Madness check if the caster fails by more than,say, 10) for a similar effect.
For non-D20 systems I recommend Warhammer Fantasy RPG-Magic is a risky thing(calling upon Chaos always is) and has a nice few sets of Petty Magic, Advanced Spells and Schools based on Colors for Light, Nature, Fire etc. (think Cleric Domains and you're close).
Amazing Engines For Faery, Queen and Country has a nice way of doing things-a Magical Skill( Alchemy, Goetics, Hedge Magic etc.) each give the caster access to several subskills(Charm, Summon, Distill, Harm and so on). The Duration, Effect,Range and other modifiers affect the total cost to the caster's Stamina-as most decent spells could knock the caster out or kill him/her, the caster then limits the spell to decrease the cost(only on a Tuesday, singing and dancing, requires rare herbs, must be cast at Midnight etc). So Magic can be cast on the fly in emergencies, but most Mages have personalized Spell Lists tweaked the thier needs...pretty fun!
I realize i've probably wandered WAY off topic, but since I don't have the two books you've described, I thought i'd try a scattershot approach...Ravenloft and Masque are pretty hardy settings and can most likely take anything you can throw at them. Rules tweaks, entire system changes, dialing the grit up or down and Magic likewise...ultimately, i'd just discuss it with your Players and see. After all, they're the ones you really have to please.