More type annotations (#697)
* Add comprehensive type annotations
- mypy.ini: expanded configuration with module-specific settings
- hookspecs.py: type annotations for hook functions
- plugins.py: typed get_plugins() return value
- recipes.py: full type annotations for parsedate, parsedatetime, jsonsplit
- utils.py: extensive type annotations including Row type alias,
TypeTracker, ValueTracker, and all utility functions
- db.py: type annotations for Database methods (__exit__,
ensure_autocommit_off, tracer, register_function, etc.) and
Queryable class methods
- tests/test_docs.py: updated to match new signature display format
* Fix type errors caught by ty check
- Add type: ignore comments for external library type stub limitations
(csv.reader, click.progressbar, IOBase.name, Callable.__name__)
- Change Iterable to Sequence for SQL where_args parameters
- Use db.table() instead of db[name] for proper Table return type
- Fix rebuild_fts return type from None to Table
- Update test_tracer to expect fewer queries (optimization side effect)
* Fix mypy type errors
- Add type: ignore comments for runtime-valid patterns mypy can't verify
- Fix new_column_types annotation to Dict[str, Set[type]]
- Add type: ignore for Default sentinel values passed to create_table
* mypy skip tests directory
* Fix CI: exclude typing imports from recipe docs, skip mypy on tests
- Add Callable and Optional to exclusion list in _generate_convert_help()
- Regenerate docs/cli-reference.rst with cog
- Add [mypy-tests.*] ignore_errors = True to skip test type errors
---------
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-16 22:11:47 -08:00
|
|
|
from __future__ import annotations
|
|
|
|
|
|
|
|
|
|
from typing import Callable, Optional
|
|
|
|
|
|
2021-08-01 21:47:39 -07:00
|
|
|
from dateutil import parser
|
|
|
|
|
import json
|
|
|
|
|
|
More type annotations (#697)
* Add comprehensive type annotations
- mypy.ini: expanded configuration with module-specific settings
- hookspecs.py: type annotations for hook functions
- plugins.py: typed get_plugins() return value
- recipes.py: full type annotations for parsedate, parsedatetime, jsonsplit
- utils.py: extensive type annotations including Row type alias,
TypeTracker, ValueTracker, and all utility functions
- db.py: type annotations for Database methods (__exit__,
ensure_autocommit_off, tracer, register_function, etc.) and
Queryable class methods
- tests/test_docs.py: updated to match new signature display format
* Fix type errors caught by ty check
- Add type: ignore comments for external library type stub limitations
(csv.reader, click.progressbar, IOBase.name, Callable.__name__)
- Change Iterable to Sequence for SQL where_args parameters
- Use db.table() instead of db[name] for proper Table return type
- Fix rebuild_fts return type from None to Table
- Update test_tracer to expect fewer queries (optimization side effect)
* Fix mypy type errors
- Add type: ignore comments for runtime-valid patterns mypy can't verify
- Fix new_column_types annotation to Dict[str, Set[type]]
- Add type: ignore for Default sentinel values passed to create_table
* mypy skip tests directory
* Fix CI: exclude typing imports from recipe docs, skip mypy on tests
- Add Callable and Optional to exclusion list in _generate_convert_help()
- Regenerate docs/cli-reference.rst with cog
- Add [mypy-tests.*] ignore_errors = True to skip test type errors
---------
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-16 22:11:47 -08:00
|
|
|
IGNORE: object = object()
|
|
|
|
|
SET_NULL: object = object()
|
2021-08-01 21:47:39 -07:00
|
|
|
|
|
|
|
|
|
More type annotations (#697)
* Add comprehensive type annotations
- mypy.ini: expanded configuration with module-specific settings
- hookspecs.py: type annotations for hook functions
- plugins.py: typed get_plugins() return value
- recipes.py: full type annotations for parsedate, parsedatetime, jsonsplit
- utils.py: extensive type annotations including Row type alias,
TypeTracker, ValueTracker, and all utility functions
- db.py: type annotations for Database methods (__exit__,
ensure_autocommit_off, tracer, register_function, etc.) and
Queryable class methods
- tests/test_docs.py: updated to match new signature display format
* Fix type errors caught by ty check
- Add type: ignore comments for external library type stub limitations
(csv.reader, click.progressbar, IOBase.name, Callable.__name__)
- Change Iterable to Sequence for SQL where_args parameters
- Use db.table() instead of db[name] for proper Table return type
- Fix rebuild_fts return type from None to Table
- Update test_tracer to expect fewer queries (optimization side effect)
* Fix mypy type errors
- Add type: ignore comments for runtime-valid patterns mypy can't verify
- Fix new_column_types annotation to Dict[str, Set[type]]
- Add type: ignore for Default sentinel values passed to create_table
* mypy skip tests directory
* Fix CI: exclude typing imports from recipe docs, skip mypy on tests
- Add Callable and Optional to exclusion list in _generate_convert_help()
- Regenerate docs/cli-reference.rst with cog
- Add [mypy-tests.*] ignore_errors = True to skip test type errors
---------
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-16 22:11:47 -08:00
|
|
|
def parsedate(
|
|
|
|
|
value: str,
|
|
|
|
|
dayfirst: bool = False,
|
|
|
|
|
yearfirst: bool = False,
|
|
|
|
|
errors: Optional[object] = None,
|
|
|
|
|
) -> Optional[str]:
|
2022-03-20 21:01:35 -07:00
|
|
|
"""
|
|
|
|
|
Parse a date and convert it to ISO date format: yyyy-mm-dd
|
|
|
|
|
\b
|
|
|
|
|
- dayfirst=True: treat xx as the day in xx/yy/zz
|
|
|
|
|
- yearfirst=True: treat xx as the year in xx/yy/zz
|
|
|
|
|
- errors=r.IGNORE to ignore values that cannot be parsed
|
|
|
|
|
- errors=r.SET_NULL to set values that cannot be parsed to null
|
|
|
|
|
"""
|
2025-11-23 15:40:28 -08:00
|
|
|
if not value:
|
|
|
|
|
return value
|
2022-03-20 21:01:35 -07:00
|
|
|
try:
|
|
|
|
|
return (
|
|
|
|
|
parser.parse(value, dayfirst=dayfirst, yearfirst=yearfirst)
|
|
|
|
|
.date()
|
|
|
|
|
.isoformat()
|
|
|
|
|
)
|
|
|
|
|
except parser.ParserError:
|
|
|
|
|
if errors is IGNORE:
|
|
|
|
|
return value
|
|
|
|
|
elif errors is SET_NULL:
|
|
|
|
|
return None
|
|
|
|
|
else:
|
|
|
|
|
raise
|
2021-08-01 21:47:39 -07:00
|
|
|
|
2022-03-20 21:01:35 -07:00
|
|
|
|
More type annotations (#697)
* Add comprehensive type annotations
- mypy.ini: expanded configuration with module-specific settings
- hookspecs.py: type annotations for hook functions
- plugins.py: typed get_plugins() return value
- recipes.py: full type annotations for parsedate, parsedatetime, jsonsplit
- utils.py: extensive type annotations including Row type alias,
TypeTracker, ValueTracker, and all utility functions
- db.py: type annotations for Database methods (__exit__,
ensure_autocommit_off, tracer, register_function, etc.) and
Queryable class methods
- tests/test_docs.py: updated to match new signature display format
* Fix type errors caught by ty check
- Add type: ignore comments for external library type stub limitations
(csv.reader, click.progressbar, IOBase.name, Callable.__name__)
- Change Iterable to Sequence for SQL where_args parameters
- Use db.table() instead of db[name] for proper Table return type
- Fix rebuild_fts return type from None to Table
- Update test_tracer to expect fewer queries (optimization side effect)
* Fix mypy type errors
- Add type: ignore comments for runtime-valid patterns mypy can't verify
- Fix new_column_types annotation to Dict[str, Set[type]]
- Add type: ignore for Default sentinel values passed to create_table
* mypy skip tests directory
* Fix CI: exclude typing imports from recipe docs, skip mypy on tests
- Add Callable and Optional to exclusion list in _generate_convert_help()
- Regenerate docs/cli-reference.rst with cog
- Add [mypy-tests.*] ignore_errors = True to skip test type errors
---------
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-16 22:11:47 -08:00
|
|
|
def parsedatetime(
|
|
|
|
|
value: str,
|
|
|
|
|
dayfirst: bool = False,
|
|
|
|
|
yearfirst: bool = False,
|
|
|
|
|
errors: Optional[object] = None,
|
|
|
|
|
) -> Optional[str]:
|
2022-03-20 21:01:35 -07:00
|
|
|
"""
|
|
|
|
|
Parse a datetime and convert it to ISO datetime format: yyyy-mm-ddTHH:MM:SS
|
|
|
|
|
\b
|
|
|
|
|
- dayfirst=True: treat xx as the day in xx/yy/zz
|
|
|
|
|
- yearfirst=True: treat xx as the year in xx/yy/zz
|
|
|
|
|
- errors=r.IGNORE to ignore values that cannot be parsed
|
|
|
|
|
- errors=r.SET_NULL to set values that cannot be parsed to null
|
|
|
|
|
"""
|
2025-11-23 15:40:28 -08:00
|
|
|
if not value:
|
|
|
|
|
return value
|
2022-03-20 21:01:35 -07:00
|
|
|
try:
|
|
|
|
|
return parser.parse(value, dayfirst=dayfirst, yearfirst=yearfirst).isoformat()
|
|
|
|
|
except parser.ParserError:
|
|
|
|
|
if errors is IGNORE:
|
|
|
|
|
return value
|
|
|
|
|
elif errors is SET_NULL:
|
|
|
|
|
return None
|
|
|
|
|
else:
|
|
|
|
|
raise
|
2021-08-01 21:47:39 -07:00
|
|
|
|
|
|
|
|
|
More type annotations (#697)
* Add comprehensive type annotations
- mypy.ini: expanded configuration with module-specific settings
- hookspecs.py: type annotations for hook functions
- plugins.py: typed get_plugins() return value
- recipes.py: full type annotations for parsedate, parsedatetime, jsonsplit
- utils.py: extensive type annotations including Row type alias,
TypeTracker, ValueTracker, and all utility functions
- db.py: type annotations for Database methods (__exit__,
ensure_autocommit_off, tracer, register_function, etc.) and
Queryable class methods
- tests/test_docs.py: updated to match new signature display format
* Fix type errors caught by ty check
- Add type: ignore comments for external library type stub limitations
(csv.reader, click.progressbar, IOBase.name, Callable.__name__)
- Change Iterable to Sequence for SQL where_args parameters
- Use db.table() instead of db[name] for proper Table return type
- Fix rebuild_fts return type from None to Table
- Update test_tracer to expect fewer queries (optimization side effect)
* Fix mypy type errors
- Add type: ignore comments for runtime-valid patterns mypy can't verify
- Fix new_column_types annotation to Dict[str, Set[type]]
- Add type: ignore for Default sentinel values passed to create_table
* mypy skip tests directory
* Fix CI: exclude typing imports from recipe docs, skip mypy on tests
- Add Callable and Optional to exclusion list in _generate_convert_help()
- Regenerate docs/cli-reference.rst with cog
- Add [mypy-tests.*] ignore_errors = True to skip test type errors
---------
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2025-12-16 22:11:47 -08:00
|
|
|
def jsonsplit(
|
|
|
|
|
value: str, delimiter: str = ",", type: Callable[[str], object] = str
|
|
|
|
|
) -> str:
|
2022-03-20 21:01:35 -07:00
|
|
|
"""
|
|
|
|
|
Convert a string like a,b,c into a JSON array ["a", "b", "c"]
|
|
|
|
|
"""
|
2021-08-01 21:47:39 -07:00
|
|
|
return json.dumps([type(s.strip()) for s in value.split(delimiter)])
|