Программирование на службе генеалогии

На сайте ВГД собираются люди, увлеченные генеалогией, историей, геральдикой и т.д. Здесь вы найдете собеседников, экспертов, умелых помощников в поисках предков и родственников. Вам подскажут где искать документы о павших в боях и пропавших без вести, в какой архив обратиться при исследовании родословной своей семьи, помогут определить по старой фотографии принадлежность к воинским частям, ведомствам и чину. ВГД - поиск людей в прошлом, настоящем и будущем!

Хотите похохотать?
(from https://realpython.com/python-program-structure/)

[q]
Deep Dive: Fortran and Whitespace

The earliest versions of Fortran, one of the first programming languages created, were designed so that all whitespace was completely ignored. Whitespace characters could be optionally included or omitted virtually anywhere—between identifiers and reserved words, and even in the middle of identifiers and reserved words.

For example, if your Fortran code contained a variable named total, any of the following would be a valid statement to assign it the value 50:

total = 50
to tal = 50
t o t a l=5 0
This was meant as a convenience, but in retrospect it is widely regarded as overkill. It often resulted in code that was difficult to read. Worse yet, it potentially led to code that did not execute correctly.

Consider this tale from NASA in the 1960s. A Mission Control Center orbit computation program written in Fortran was supposed to contain the following line of code:

DO 10 I = 1,100
In the Fortran dialect used by NASA at that time, the code shown introduces a loop, a construct that executes a body of code repeatedly. (You will learn about loops in Python in two future tutorials on definite and indefinite iteration).

Unfortunately, this line of code ended up in the program instead:

DO 10 I = 1.100
If you have a difficult time seeing the difference, don’t feel too bad. It took the NASA programmer a couple weeks to notice that there is a period between 1 and 100 instead of a comma. Because the Fortran compiler ignored whitespace, DO 10 I was taken to be a variable name, and the statement DO 10 I = 1.100 resulted in assigning 1.100 to a variable called DO10I instead of introducing a loop.

Some versions of the story claim that a Mercury rocket was lost because of this error, but that is evidently a myth. It did apparently cause inaccurate data for some time, though, before the programmer spotted the error.
[/q]

Не смешно? Не страшно.
Читайте тогда это: https://www.python.org/dev/peps/pep-0020/

[q]
The Zen of Python
Beautiful is better than ugly.
Explicit is better than implicit.
Simple is better than complex.
Complex is better than complicated.
Flat is better than nested.
Sparse is better than dense.
Readability counts.
Special cases aren't special enough to break the rules.
Although practicality beats purity.
Errors should never pass silently.
Unless explicitly silenced.
In the face of ambiguity, refuse the temptation to guess.
There should be one-- and preferably only one --obvious way to do it.
Although that way may not be obvious at first unless you're Dutch.
Now is better than never.
Although never is often better than *right* now.
If the implementation is hard to explain, it's a bad idea.
If the implementation is easy to explain, it may be a good idea.
Namespaces are one honking great idea -- let's do more of those!
[/q]

Как весело проиграть на бирже 100 долларов, найденные на дороге

(источник: https://realpython.com/python-rounding/ How to Round Numbers in Python)

[q]
How Much Impact Can Rounding Have?
Suppose you have an incredibly lucky day and find $100 on the ground. Rather than spending all your money at once, you decide to play it smart and invest your money by buying some shares of different stocks.

The value of a stock depends on supply and demand. The more people there are who want to buy a stock, the more value that stock has, and vice versa. In high volume stock markets, the value of a particular stock can fluctuate on a second-by-second basis.

Let’s run a little experiment. We’ll pretend the overall value of the stocks you purchased fluctuates by some small random number each second, say between $0.05 and -$0.05. This fluctuation may not necessarily be a nice value with only two decimal places. For example, the overall value may increase by $0.031286 one second and decrease the next second by $0.028476.

You don’t want to keep track of your value to the fifth or sixth decimal place, so you decide to chop everything off after the third decimal place. In rounding jargon, this is called truncating the number to the third decimal place. There’s some error to be expected here, but by keeping three decimal places, this error couldn’t be substantial. Right?

To run our experiment using Python, let’s start by writing a truncate() function that truncates a number to three decimal places:

>>> def truncate(n):
... return int(n * 1000) / 1000
The truncate() function works by first shifting the decimal point in the number n three places to the right by multiplying n by 1000. The integer part of this new number is taken with int(). Finally, the decimal point is shifted three places back to the left by dividing n by 1000.

Next, let’s define the initial parameters of the simulation. You’ll need two variables: one to keep track of the actual value of your stocks after the simulation is complete and one for the value of your stocks after you’ve been truncating to three decimal places at each step.

Start by initializing these variables to 100:

>>> actual_value, truncated_value = 100, 100
Now let’s run the simulation for 1,000,000 seconds (approximately 11.5 days). For each second, generate a random value between -0.05 and 0.05 with the uniform() function in the random module, and then update actual and truncated:

>>> import random
>>> random.seed(100)

>>> for _ in range(1000000):
... randn = random.uniform(-0.05, 0.05)
... actual_value = actual_value + randn
... truncated_value = truncate(truncated_value + randn)
...

>>> actual_value
96.45273913513529

>>> truncated_value
0.239
The meat of the simulation takes place in the for loop, which loops over the range(1000000) of numbers between 0 and 999,999. The value taken from range() at each step is stored in the variable _, which we use here because we don’t actually need this value inside of the loop.

At each step of the loop, a new random number between -0.05 and 0.05 is generated using random.randn() and assigned to the variable randn. The new value of your investment is calculated by adding randn to actual_value, and the truncated total is calculated by adding randn to truncated_value and then truncating this value with truncate().

As you can see by inspecting the actual_value variable after running the loop, you only lost about $3.55. However, if you’d been looking at truncated_value, you’d have thought that you’d lost almost all of your money!

Note: In the above example, the random.seed() function is used to seed the pseudo-random number generator so that you can reproduce the output shown here.
[/q]

[q]
Shocking as it may seem, this exact error caused quite a stir in the early 1980s when the system designed for recording the value of the Vancouver Stock Exchange truncated the overall index value to three decimal places instead of rounding. Rounding errors have swayed elections and even resulted in the loss of life.

How you round numbers is important, and as a responsible developer and software designer, you need to know what the common issues are and how to deal with them. Let’s dive in and investigate what the different rounding methods are and how you can implement each one in pure Python.
[/q]

Другая песня - Django

RealPython рекомендует
Курсы особенно не поиспользуешь - большая часть каждого из курсов платна.
У tutorials другая беда - нет к ним quizzes

- [Course] Get Started With Django: Build a Portfolio App https://realpython.com/courses/django-portfolio-project/
Learn the basics of creating powerful web applications with Django, a Python web framework. You'll build a portfolio website to showcase your web development projects, complete with a fully functioning blog.
Бесплатна только начальная часть курса
[Tutorial] Get Started With Django Part 2: Django User Management https://realpython.com/django-user-management/
Learn how to extend your Django application with a user management system, complete with email sending and third-party authentication.
[Course] Get Started With Django Part 3: Django View Authorization https://realpython.com/courses/django-view-authorization/
Django View Authorization: Restricting Access
This course covers how to restrict your web pages to users with different roles through Django view authorization. You'll learn about HttpRequest.user objects, view decorators that authenticate, and how to notify your users with the Django messages framework.
[Course] Python Application Layouts and Project Structures https://realpython.com/courses...plication/
Structuring a Python Application
This course is a reference guide to common Python application layouts and project structures for command-line applications, web applications, and more.
[Course] Django Migrations 101 https://realpython.com/courses/django-migrations-101/
With this course you’ll get comfortable with Django migrations and learn how to create database tables without writing any SQL, how to automatically modify your database after you changed your models, and how to revert changes made to your database.
[Tutorial] Digging Deeper Into Django Migrations https://realpython.com/digging-deeper-into-migrations/
In this step-by-step Python tutorial, you'll not only take a closer look at the new Django migrations system that is integrated into Django but also walk through the migration files themselves.
[Course] Make a Location-Based Web App With Django and GeoDjango https://realpython.com/courses...geodjango/
Learn how to use Django and GeoDjango to build a location-based web application from scratch. You’ll be building a simple nearby shops application that lists the shops closest to a user’s location.
[Tutorial] How to Provide Test Fixtures for Django Models in Pytest https://realpython.com/django-pytest-fixtures/
Learn how to use fixtures to simplify your testing in pytest. If you use Django, pytest fixtures can help you write tests that are painless to update and maintain even as you make changes to your models.
[Course] Django Redirects Tutorial https://realpython.com/courses/django-redirects/
Learn everything you need to know about HTTP redirects in Django. All the way from the low-level details of the HTTP protocol to the high-level way of dealing with them in Django.
[Tutorial] Modeling Polymorphism in Django With Python https://realpython.com/modeling-polymorphism-django-python/
Modeling polymorphism in relational databases can be a challenging task, but in this article, you'll learn several modeling techniques to represent polymorphic objects in a relational database using the Django object-relational mapping (ORM).
[Tutorial] What You Need to Know to Manage Users in Django Admin https://realpython.com/manage-users-in-django-admin/
Learn what you need to know to manage users in Django admin. Out of the box, Django admin doesn't enforce special restrictions on the user admin. This can lead to dangerous scenarios that might compromise your system.
[Course] Customize the Django Admin With Python https://realpython.com/courses/django-admin-customization/
Learn how to customize Django's admin with Python. You'll use AdminModel objects to add display columns, calculate values, link to referring objects, and search and filter results. You'll also use template overriding to gain full control over the admin's HTML.
[Tutorial] How to Create an Index in Django Without Downtime https://realpython.com/create-django-index-without-downtime/
Get a solid understanding of the limitations of Django migrations by tackling a well known problem: creating an index in Django with no downtime.
[Tutorial] How to Write an Installable Django App https://realpython.com/installable-django-app/
Learn how to create an installable Django app. You'll cover everything you need to know, from extracting your app from a Django project to turning it into a package that's available on PyPI and installable through pip.
[Tutorial] How to Move a Django Model to Another App https://realpython.com/move-django-model/
Learn how to move a Django model from one app to another using Django migrations. You'll explore three different techniques and learn some helpful guidelines for choosing the best approach for your situation and needs.
[Course] Building HTTP APIs With Django REST Framework https://realpython.com/courses/django-rest-framework/
This course will get you ready to build HTTP APIs with Django REST Framework. The Django REST framework (DRF) is a toolkit built on top of the Django web framework that reduces the amount of code you need to write to create REST interfaces.

LinkedIn recommends (13 results for the search of "Django"):
Они хитренькие, но не так уж. Курсы все платные (зато с сертификатом). Но если успеешь пройти и получить сертификат, а потом отменить регистрацию, то и усе.
Да к тому же, LinkedIn доступен в России только через VPN (я вынужден использовать Tor browser)
В 2020 получил 8 сертификатов, зарегистрировавшись в "Start free month" (если за месяц успеешь получить сертификаты, можно снять регистрацию)

[q]

Start your 1-month free trial. Cancel anytime.
Monthly
1-month free trial
then RUB2,239.00/month*
Save 33%
Annually
1-month free trial
then RUB1,489.00/month*
We’ll remind you 7 days before your free trial ends. You won’t be charged until December 29, 2021.
[/q]

Зарегистрировался. Теперь надо окончить курсы до 29 декабря 2021, иначе в конце пути придется рассчитаться.
17.12.21 Окончил все 10 курсов и отменил подписку "Learning Premium"
Ох! Я забыл, что сертификат дается за прохождение курса, а последнее означает всего лишь честный просмотр видео. Так что для настоящей учебы придется искать что-то другое..

+ Learning Django
files https://github.com/LinkedInLearning/learning-django-2825501
29.11.21 Certificate Файл CertificateOfCompletion_Learning Django.pdf, 217 Кб
Course • 1h 40m
By: Caleb Smith • Released Apr 23, 2020
19K viewers
+ Django Essential Training [Замечательный курс! Рекомендую]
files https://tutsnode.com/django-essential-training/
16.12.21 Certificate https://www.linkedin.com/learn...7f840b6321
Course • 2h 6m
By: Leticia Portella • Released Sep 23, 2021
+ Django: Forms
16.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 2h 0m
By: Nick Walter • Released Mar 8, 2019
18.5K viewers
+ Building a Personal Portfolio with Django
17.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 1h 54m
By: Nick Walter • Released Oct 8, 2018
20.7K viewers
+ Building RESTful Web APIs with Django
17.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 1h 9m
By: Rudolf Olah • Released Mar 27, 2019
10.9K viewers
+ Building React and Django Apps
17.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 56m
By: Rudolf Olah • Released Dec 4, 2019
6.8K viewers
+ Building a Paid Membership Site with Django
17.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 1h 15m
By: Nick Walter • Released Mar 1, 2019
5.4K viewers
+ Securing Django Applications
17.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 1h 18m
By: Rudolf Olah • Released Oct 6, 2020
1.1K viewers
+ Test-Driven Development in Django
17.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 1h 23m
By: Nick Walter • Released Mar 12, 2019
4.2K viewers
+ Deploying Django Apps: Make Your Site Go Live
17.12.21 Certificate https://www.linkedin.com/learn...ertificate
Course • 2h 43m
By: Nick Walter • Released Mar 15, 2019
5.3K viewers

10 Best and Free Django courses Online with certifications https://onlinecoursetutorials....fications/

Becoming a Django Developer from Linkedin Learning [см. выше]
Try Django: Learn and Master the Python Programming Web Framework (SkillShare) [нет сертификатов]
Python Django Tutorial – Full Stack Web Developer Bootcamp (Udemy) [сертификат, сегодня цена со скидкой 2190р ]
Django 2.2 & Python | Web Development Training (Udemy) [упражнения, сертификат, сегодня цена со скидкой 849р]
Django 1.1 for Beginners Certificate Course (Udemy) [упражнения, сертификат, сегодня цена со скидкой 649р]
Django Courses & Tutorials Online (Pluralsight) [free trial 10 дней, насчет цены и сертификата неясно]
Free Django Tutorial & Training (LinkedIn Learning – Lynda) [опять LinkedIn - см. выше]
Learn Python Django From Scratch – Udemy [упражнений нет, сертификат, сегодня цена 649р]
A beginner’s guide to Django – Free from Udemy [упражнений и сертификата нет, бесплатно]
+? Building Web Applications in Django -Coursera+MichiganSU [сертификат, пробный период 7 дней, после него 2827р в месяц] [начал курс] 02.11 закончил курс, получил сертификат https://coursera.org/share/c1379f5a9cf396cb2b41d2139043c697

30.11 Сам по себе курс от Coursera+MSU (рассчитан на 4 недели, но закончить придется за неделю, до 06.12, иначе попаду на деньги) на любителя - просто серия видео-бесед; однако там есть
1) в каждой неделе по два их внутренних теста
2) в трех из четырех недель - какие-то внешние (от другого производителя) великие и ужасные
Auto-grader: Django Tutorial part 2, Auto-grader: Django Tutorial part 3, Auto-grader: Django Tutorial part 4

Вот откуда торчат ушки и растут ноги у великих и ужасных:
Django for Everybody https://www.dj4e.com/

[q]
Technology
This site uses Tsugi framework to embed a learning management system into this site and handle the autograders. If you are interested in collaborating to build these kinds of sites for yourself, please see the http://www.tsugi.org/ website.
[/q]

Готовиться буду по

замечательному курсу (который одновременно предоставляет идеальную платформу для работы)
Django Tutorial in Visual Studio Code https://code.visualstudio.com/docs/python/tutorial-django
Django documentation https://docs.djangoproject.com/en/3.0/

1. Создал проект в VisualStudioCode в соответствии с их руководством.
2. Теперь буду идти в VSC по руководству https://docs.djangoproject.com/en/3.0/intro/tutorial01/, танцуя не от печки, а от "Creating the Polls app"
3. Week1 https://docs.djangoproject.com/en/3.0/intro/tutorial02/
3. Week2 https://docs.djangoproject.com/en/3.0/intro/tutorial03/
4. Week3 https://www.py4e.com/html3/14-objects https://docs.djangoproject.com...c-display/
5. Week4 https://docs.djangoproject.com/en/3.0/intro/tutorial04/ https://docs.djangoproject.com.../builtins/

01.12 Week1 test1 88,88 % (8 из 9) test2 100% test3 85,71 % (6 из 7) Над тестом 2 (великим и ужасным) пришлось изрядно попотеть (из-за необходимости результат на проверку помещать на хостинг) https://borisalekseev.pythonanywhere.com/admin/
02.12 Week2 test1 100 % (8 из 8) test2 100% test3 90,90 % (10 из 11) https://borisalekseev.pythonanywhere.com/polls/
02.12 Week3 test1 100 % (9 из 9) test2 90 % (9 из 10)
02.12 Week4 test1 ?? test2 ?? test3 100%

До смешного доходит, право слово. Новая морковка появилась (а срок-то прежний - до 06.12). Оказывается этот курс входит в специализацию "Django for Everybody" https://www.coursera.org/specializations/django, в которой всего 4 курса, включая этот

+(03.12) Web Application Technologies and Django https://www.coursera.org/learn...ion=django [рассчитано аж на 5 недель! Они что, с дуба рухнули, мне жизни-то (до 5 окт. 2038) осталось 16 лет с копейками..]
Adding HTML Content to Django https://www.dj4e.com/assn/dj4e_html.md
Сертификат https://coursera.org/share/3ec7b330616ea29b6638ed629ea362f6
+(02.12) Building Web Applications in Django https://www.coursera.org/learn...ion=django
Сертификат https://coursera.org/share/c1379f5a9cf396cb2b41d2139043c697
Django Features and Libraries https://www.coursera.org/learn/django-features-libraries [рассчитано на 6 недель! на какой планете они живут?]
SQLite Browser https://sqlitebrowser.org/
Using JavaScript, JQuery, and JSON in Django https://www.coursera.org/learn/django-javascript-jquery-json

05.12 Отменил подписку досрочно, не сдав два последних курса (и не получив оставшиеся два сертификата). Другие задачи на горизонте, да и резюме для turing надо подправить наконец..

16.12.21 TutsNode - Free Educational Tutorials https://tutsnode.com/ в частности https://tutsnode.com/django-essential-training/

Объявил о намерении создать собственную базу генеалогической информации на основе СУБД https://forum.vgd.ru/post/5/ro...#pp4017151
https://forum.vgd.ru/post/5/62699/p4017161.htm#pp4017161
Если и когда будет проявлен некоторый интерес со стороны публики.

Что делают другие (которые уже что-то сделали):

16.12.21 Памяти героев Великой войны 1914–1918 https://gwar.mil.ru/about/ - 6 666 243 записи из Картотеки Бюро по учету потерь на фронтах войны 1914–1918 гг., 5 606 545 записей, полученных из дел с именными списками потерь солдат и офицеров Первой мировой войны, 3 465 033 записи – из документов по военнопленным. Перечень воинских захоронений и мемориальных комплексов отображаются в виде списка или на современной карте. Представленные электронные копии паспортов 476 захоронений содержат записи о 8 133 известных и 38 940 неизвестных воинах, а также современные фотографии большинства захоронений и их 3D-модели. Информационный ресурс также содержит 845 168 записей о награждениях.
16.12.21 Российский Родословный Фонд https://rgfond.ru/ - 305451 персон, 8255 изображений персон
16.12.21 Интерактивные карты Галиции https://maps.geshergalicia.org...ia7FcF_3Fk
16.12.21 Волков Сергей Владимирович. Высшее чиновничество Российской империи. Краткий словарь https://history.wikireading.ru/hUWDnus38Y
16.12.21 Списки выпускников учебных заведений г. Москвы http://www.genarh.ru/spis.htm
16.12.21 Петербургские сайты полезные для генеалогов http://petergen.com/personal.shtml
в частности
Сайт Александра Александровича Бовкало http://petergen.com/bovkalo/index.html
и его "Списки выпускников духовных учебных заведений" http://petergen.com/bovkalo/duhov.html

Еще из сделанного:

ГЕНЕО forum.genoua.name/index.php - практически БД репрессированных на Украине (к сожалению, не знаю статистики)

abv
Сайт genoua.name/ пустой
На форуме
GENEO-ГЕНЕО → ГЕОГРАФИЧЕСКИЙ УКАЗАТЕЛЬ forum.genoua.name/viewforum.php?id=280
Это оно? Или БД персоналий (а не геогр. мест) имеет другой адрес?

Чего не делают остальные(во всяком случае - я не встречал) - https://forum.vgd.ru/post/1304/126868/p4013225.htm#pp4013225
Хотя тема интересная(как мне кажется) и может быть востребована. Даже подумывал можно ли её реализовать на https://uguide.ru/konstruktor-...понравился сам подход - формирование готового кода для вставки на сайт)
Есть идеи как это возможно должно функционировать(как лично мне это представляется). Если заинтересовал - можем продолжить обсуждение(в ЛС)....

Vodnik_dnepr написал:

[q]

Есть идеи как это возможно должно функционировать(как лично мне это представляется). Если заинтересовал - можем продолжить обсуждение(в ЛС)....
[/q]

А почему бы нет. Можно и обсудить.

Блок1 - "Выбор архива"
Блок 2(условно "Я сам") - затраты на дорогу, проживание, питание
Блок 3(условно "Я хочу получить") - реквизиты дела, необходимость копий, глубина поиска и т.п.
"Расчет"
Блок 4 "Вывод результатов"
4.1 Затраты при самостоятельном поиске в архиве
4.2. Затраты при запросе в архив
4.3. Затраты при местном исполнителе
4.4. Тоже при работе через посредника
4.5. Затраты при работе иногороднего исполнителя
4.6. Тоже при работе через посредника
4.7. Затраты при привлечении фирмы-исполнителя

Схема примерно такая....

abv
А откуда данные брать? С сайтов архивов? Из личного опыта избранных людей? Есть у вас готовые сведения?