Overriding JFormRules
From Joomla! Documentation
To extend the rules that can be used by Joomla to validate form input, the following changes are needed:
Step 1: Alter the controller
In the controller function add these lines:
$form = $model->getForm();
$form->addRulePath(JPATH_COMPONENT.'/models/rules');
Step 2: Add the rule files
In the folder models/rules in the component add any rule file you want to use.