====== NAS Installation - Synology DSM 6.1 (Hermes) ======

Hua Hin cloud server 2017 on Synology DS716+.

===== Specification =====
  * Intel Celeron N3160 quad core
  * 2 HGST Deskstar NAS 6TB HDD
  * 2 GB RAM

===== Setup =====

  - Find the DS through http://find.synology.com.
  - Create a volume in //Storage Manager//
  - Configure Network settings in //Control Panel//. Select the 2nd LAN and click //Create Bond//.
  - Enable user home service in //Control Panel --> User --> Advanced//.
  - Set disk full warning setting in //Control Panel --> Notification --> Advanced --> Internal Storage --> Volume Full//.
  - Enable the widgets you want to use on your home screen.
  - To setup SSL, import __server.key__, __domain.crt__, and __domain.intermediate.crt__ through //Control Panel --> Security --> Certificate --> Add//. Right click on the new certificate, "Edit" to make it default, "Configure" to assign it to services. Detailed instructions see [[https://miketabor.com/secure-synology-nas-install-ssl-certificate/|Secure your Synology NAS, install a SSL certificate]] and [[https://www.sslshopper.com/how-to-move-or-copy-an-ssl-certificate-from-one-server-to-another.html|How to Move or Copy an SSL Certificate from one Server to Another]].
  - Add Two-factor-authentication to your admin user. Select **Options -> Personal** on the top right of the DSM window. Settings are saved in<code>/usr/syno/etc/preference/username/google_authenticator</code>

===== DDNS over Namecheap =====
  - Add the host to be accessed with DDNS to your domain's //Advanced DNS --> Dynamic DNS// in Namecheap
  - Make sure you installed php-curl and php-xml in your [[deb11:apache#php_installation|Apache 2.4 and PHP 7/8]] installation
  - Add the following script to your webserver:<code><?php
try {
        $url = 'https://dynamicdns.park-your-domain.com/update?host='.$_GET['host'].'&domain='.$_GET['domain'].'&password='.$_GET['password'].'&ip='.$_GET['ip'];

        // with allow_url_fopen enabled
        $output = file_get_contents($url);

        // with curl
        //$req = curl_init();
        //curl_setopt($req, CURLOPT_URL, $url);
        //curl_setopt($req, CURLOPT_RETURNTRANSFER, true);
        //curl_setopt($ch, CURLOPT_HTTPHEADER, array('Content-type: text/xml'));
        //$output = curl_exec($req);
        //curl_close($req);

        $xml = new SimpleXMLElement(trim(str_replace("encoding=\"utf-16\"","",$output)));
        if ($xml->ErrCount > 0) {
                $error = $xml->errors[0]->Err1;
                if (strcmp($error, "Domain name not found") === 0) {
                        echo "nohost";
                } elseif (strcmp($error, "Passwords do not match") === 0) {
                        echo "badauth";
                } elseif (strcmp($error, "Passwords is empty") === 0) {
                        echo "badauth";
                } elseif (strcmp($error, "No Records updated. A record not Found;") === 0) {
                        echo "nohost";
                } else {
                   echo "911 [".$error."]";
                }
        } else {
                echo "good";
        }
} catch (Exception $e) {
    echo "911 [".$e->getMessage()."]";
}</code>
  - Make sure the DDNS update call is allowed by your webserver. For apache, add this to the conf:<code><RequireAny>
Require expr "%{QUERY_STRING} =~ /your Namecheap DDNS password/" # allow the DDNS updater to run from the changed ip address
Require forward-dns host.domain.tld # allow access from the DDNS domain name after updating the ip address
</RequireAny></code>
  - Create a custom DDNS updater in Synology DSM with the following //Query URL//:<code>https://vps.condrau.com/html/ddns-namecheap.php?host=__USERNAME__&domain=__HOSTNAME__&password=__PASSWORD__&ip=__MYIP__</code>
  * [[https://code-bude.net/2022/02/16/namecheap-com-ddns-in-synology-dsm-einrichten/|Namecheap.com DDNS in Synology DSM einrichten]]
  * [[https://www.namecheap.com/support/knowledgebase/article.aspx/29/11/how-to-dynamically-update-the-hosts-ip-with-an-http-request/|How to dynamically update the host's IP with an HTTP request?]]

===== Certificates =====
If you are running a Synology NAS to handle cloud and mail, but another webserver to handle https sites, you will end up with some certificate issues. I solve those by updating the certificate on the web server and then copy the renewed certificate over to the NAS.
  - Check the path to rsync:<code>which rsync</code>
  - First, allow rsync to be executed as root on both machines. Add the following line to file 'rsync' under 'sudoers.d':<code>user ALL=(root) NOPASSWD:/path/to/rsync</code>
  - As a user on your NAS you can suck the data from your source server like this:<code>sudo rsync -aPLe 'ssh -l user -i /volume1/homes/user/.ssh/id_rsa' --rsync-path='sudo rsync' pandora:/etc/letsencrypt/live/cloud.domain.tld/fullchain.pem /usr/syno/etc/certificate/_archive/<dir>/cert.pem</code>
  - You can find the directory where your default certificate is stored in on your NAS with the following command:<code>cat /usr/syno/etc/certificate/_archive/DEFAULT</code>
  - Copy the rsync commands into a batch file on the NAS and add the batch file to the task scheduler:<code>sudo -u bco sh /volume1/homes/bco/batch/copycert</code>
  - Content of "copycert":<code>#!/bin/sh
#
# Copy certificates from web server to NAS
#  you must add user to be able to run cksum with sudo without password on the remote machine
# (c) 2019-08-06, 2019-11-27, 2020-02-21, Bernard Condrau
#
# CERTDIR must be hardcoded and is different in every server instance
#  see https://github.com/Neilpang/acme.sh/wiki/Synology-NAS-Guide
#  if you used the normal method the certificate will be installed in the "system/default" directory
#  if you used the alternative method it is copied to an unknown path, you can find it in file "_archive/DEFAULT"
# CERTDIR="system/default"
CERTDIR="_archive/4LSLbi"
CERTROOTDIR="/usr/syno/etc/certificate"
PACKAGECERTROOTDIR="/usr/local/etc/certificate"
FULLCERTDIR="$CERTROOTDIR/$CERTDIR"

# compare cksums first to decide whether certificates need to be copied
REM_CERT=$(ssh -i /volume1/homes/bco/.ssh/id_rsa bco@pandora sudo cksum /etc/letsencrypt/live/cloud.condrau.com/cert.pem | cut -d' ' -f 1)
REM_FULL=$(ssh -i /volume1/homes/bco/.ssh/id_rsa bco@pandora sudo cksum /etc/letsencrypt/live/cloud.condrau.com/fullchain.pem | cut -d' ' -f 1)
REM_PRIV=$(ssh -i /volume1/homes/bco/.ssh/id_rsa bco@pandora sudo cksum /etc/letsencrypt/live/cloud.condrau.com/privkey.pem | cut -d' ' -f 1)
LOC_CERT=$(cksum /usr/syno/etc/certificate/$CERTDIR/cert.pem | cut -d' ' -f 1)
LOC_FULL=$(cksum /usr/syno/etc/certificate/$CERTDIR/fullchain.pem | cut -d' ' -f 1)
LOC_PRIV=$(cksum /usr/syno/etc/certificate/$CERTDIR/privkey.pem | cut -d' ' -f 1)

if [[ $LOC_CERT -ne $REM_CERT ]] || [[ $LOC_FULL -ne $REM_FULL ]] || [[ $LOC_PRIV -ne $REM_PRIV ]]; then

    # copy certificates from web server
    sudo rsync -aPLe 'ssh -l bco -i /volume1/homes/bco/.ssh/id_rsa' --rsync-path='sudo rsync' pandora:/etc/letsencrypt/live/cloud.condrau.com/cert.pem $FULLCERTDIR/cert.pem
    sudo rsync -aPLe 'ssh -l bco -i /volume1/homes/bco/.ssh/id_rsa' --rsync-path='sudo rsync' pandora:/etc/letsencrypt/live/cloud.condrau.com/fullchain.pem $FULLCERTDIR/fullchain.pem
    sudo rsync -aPLe 'ssh -l bco -i /volume1/homes/bco/.ssh/id_rsa' --rsync-path='sudo rsync' pandora:/etc/letsencrypt/live/cloud.condrau.com/privkey.pem $FULLCERTDIR/privkey.pem

    # find all subdirectories containing cert.pem files
    PEMFILES=$(find $CERTROOTDIR -name cert.pem)
    if [ ! -z "$PEMFILES" ]; then
        for DIR in $PEMFILES; do
            # replace the certificates, but never the ones in the _archive folders as those are all the unique certificates on the system.
            if [[ $DIR != *"/_archive/"* ]]; then
                rsync -avh "$FULLCERTDIR/" "$(dirname $DIR)/"
            fi
        done
    fi

    # reload
    /usr/syno/sbin/synoservicectl --reload nginx

    # update and restart all installed packages
    PEMFILES=$(find $PACKAGECERTROOTDIR -name cert.pem)
    if [ ! -z "$PEMFILES" ]; then
        for DIR in $PEMFILES; do
            #active directory has it's own certificate so we do not update that package
            if [[ $DIR != *"/ActiveDirectoryServer/"* ]]; then
                rsync -avh "$FULLCERTDIR/" "$(dirname $DIR)/"
                /usr/syno/bin/synopkg restart $(echo $DIR | awk -F/ '{print $6}')
            fi
        done
    fi
    echo "certificates updated"
else
    echo "nothing to update"
fi

exit 0</code>
  - You must add the following line at the end of the sudoers file with 'visudo' for the above script to work<code>user  ALL=(ALL)  NOPASSWD: /usr/bin/cksum</code>

==== Links ====
  * [[https://www.synology.com/en-global/knowledgebase/SRM/help/SRM/RouterApp/security_certificate|Create, import, export, and renew certificates]]
  * [[https://forum.synology.com/enu/viewtopic.php?f=19&t=71664&p=425445&hilit=step+email+authentication#p425445|Two Step Authentication]]
  * [[https://serverfault.com/questions/136549/rsync-over-ssh-with-root-access-on-both-sides|Rsync over ssh with root access on both sides]]
  * [[https://www.reddit.com/r/synology/comments/cdsfj7/cloud_station_drive_and_untrusted_ssl_certificate/|Version: 6.2.2-24922 Update 4 is out - fixes certificate renewal bug]]
  * [[https://github.com/Neilpang/acme.sh/wiki/Synology-NAS-Guide|HTTPS certificates for your Synology NAS using acme.sh]]
===== Shared Folders =====
  * [[https://www.synology.com/en-global/dsm/feature/security|Security]]
  * [[http://code.opoki.com/sftp-synology-nas/|How to use SFTP on synology NAS server]]
  * [[https://www.reddit.com/r/synology/comments/b0n7hr/fixing_permissions_after_mass_data_ingestion/|Fixing Permissions]]
  * [[https://www.synology.com/en-global/knowledgebase/DSM/tutorial/General_Setup/How_to_migrate_between_Synology_NAS_DSM_5_0_and_later|How to migrate between Synology NAS (DSM 5.x)
]]

===== Change hostname =====
  * Change //Server Name// in //Control Panel --> Network --> General//
  * Update:<code>sudo vim /etc/synoinfo.conf
custom_login_title="hostname"</code>
  * Update:<code>sudo vim /etc/sysconfig/network
HOSTNAME=hostname</code>
===== MailPlus Server =====
  * Copy DKIM Settings following {{ :syno:synology_mailplus_server_admin_guide_enu.pdf |MailPlus Server Admin Guide}} page 72 to your DNS.
  * [[syno:dsm6dns|DNS Settings]]

===== Contacts =====
  - Install Synology Contacts
  - Click the **+** behind PERSONAL ADDRESS BOOK and select "Import Address Book" to import your address book from an existing CardDAV server or from a vCard file (extension .vcf) and name it something like //user_CardDAV//.
  - If you want to keep an archive of all your contacts before deleting unused contacts, import the same address book again into PERSONAL or GROUP ADDRESS BOOK and name it something like //archive_user_CardDAV//. Do not sync this address book, keep it as archived backup, and it can be exported to a vCard file later if required.
  - Click the 3 dots to the right of your new address book and check the URL which you need for setting up DAVx<sup>5</sup> below, the URL you need is the one under **iOS** (not CardDAV client!)
  - Install DAVx<sup>5</sup>. Add a new account as "Login with URL and user name", then enter the CardDAV base URL taken from the web interface explained in the step before. It should look like this:<code>http://diskstation.name:5000/carddav/<user>/ # local network
https://domain.name.tld:5001/carddav/<user>/ # internet</code>
  * Note: ContactSync for Android is another CardDAV, it is not freee, but has an automated setup for Synology DSM.
  * [[https://www.davx5.com/tested-with/synology|DAVx⁵ has been successfully tested with Synology DSM]]

===== Calendar =====
  - Install Synology Calendar
  - Click the **v** behind your calendar in the right pane, select //CalDAV Account//, and check the URL which you need for setting up DAVx<sup>5</sup> below, the URL you need is the one under **macOS / iOS** (not Thunderbird!)
  - Install DAVx<sup>5</sup>. Add a new account as "Login with URL and user name", name it with your main email address, then enter the CalDAV base URL taken from the web interface explained in the step before. It should look like this:<code>http://diskstation.name:5000/caldav/<user>/ # local network
  - Make sure you select the correct calendar as default for new appointments on your Android device
https://domain.name.tld:5001/caldav/<user>/ # internet</code>
  * Note: CalendarSync for Android is another CalDAV client, it is not free, but has an automated setup for Synology DSM.
  * [[https://www.davx5.com/tested-with/synology|DAVx⁵ has been successfully tested with Synology DSM]]

===== Customization =====
  * Find all Synology package icons in /var/cache/pkglist.tmp/icon/AVAIL/SYNO
===== Replace Harddisks =====

==== DSM 6 ====
  - Shut down the NAS and replace the first disk. Numbering of disks is from left to right.
  - Boot the NAS and add the new disk to the Raid. It takes about 20 hours to rebuild the Raid.
  - Repeat steps 1 and 2 for the other disk.
  - Expand the Raid volume if the new disks are higher capacity than the replaced ones.
==== Command Line ====
Since DSM 6 the Synology NAS features a linux kernel, so Raid management can also be done on the command line. Since the Diskstation 212+ and 213+ do not support HGST Deskstar 10TB drives, I started to look into this to find a way how to make it work. Here is what I found:
  - I replaced a failed HGST 6TB with a new HGST 10TB and rebuilt the Raid through the DSM GUI.
  - I then replaced the other HGST 6TB with a new HGST 10TB and rebuilt the Raid through the DSM GUI.
  - Extending the Raid volume through the GUI did not work.
  - After rebooting the NAS the data volume Raid degraded. Interestingly, the other 2 Raids (boot, swap) did not degrade<code># cat /proc/mdstat
Personalities : [linear] [raid0] [raid1] [raid10] [raid6] [raid5] [raid4]
md2 : active raid1 sda3[2]
      5855800416 blocks super 1.2 [2/1] [U_]
md1 : active raid1 sda2[0] sdb2[1]
      2097088 blocks [2/2] [UU]
md0 : active raid1 sda1[0] sdb1[1]
      2490176 blocks [2/2] [UU]
unused devices: <none></code>
  - I then rebuilt the Raid from the command line and created a conf file<code># mdadm --add /dev/md2 /dev/sdb3
# mdadm --detail --scan > /etc/mdadm.conf</code>
  - I now can boot the NAS without problems.

===== Remove IPKG/Optware =====
  - comment out every reference to optware in /etc/rc.local
  - restart DS
  - check that optware has not been loaded, e.g. /opt is empty, and sudo will work without change of path
  - rm -R /opt
  - rm -R /volume1/opt or rm -R /volume1/@optware (depends on where you installed your IPKG)
  - delete every reference to optware in /etc/rc.local
  - delete /etc/rc.optware
  * [[https://forum.synology.com/enu/viewtopic.php?t=75042|remove ipkg]]
  * [[https://forum.synology.com/enu/viewtopic.php?t=19678|How to uninstall IPKG / Optware?]]

===== SSH Access =====
  - Copy the private key into .ssh/authorized_keys
  - Make sure the homes/user directory, .ssh, and the authorized_keys file are accessible by the owner/user only<code>cd /var/services/homes/user
sudo chmod 700 .
sudo chmod 700 .ssh
sudo chmod 600 authorized_keys</code>
  * [[https://forum.synology.com/enu/viewtopic.php?t=126166|Logging into Synology SSH using a key instead of a password]]
  * [[https://kb.synology.com/en-global/DSM/tutorial/Why_can_t_I_connect_to_my_Synology_NAS_over_the_Internet_via_QuickConnect|I can't connect to my Synology device via QuickConnect]]

===== Rsync =====
  - Enable Rsync in Control Panel --> File Services. Do not enable rsync account.
  - Give user r/w permissions for shared folder "homes"
  - Give user rsync application permission
  - Make sure user has SSH access to the box with key file
  - rsync command example:<code>rsync -av -e ssh sample.file user@machine:/var/services/homes/user/</code>

===== BackupPC Integration =====
Follow this guide: [[deb10:backuppc#Configuration_on_Synology_DSM6_Hosts|Configuration on Synology DSM6 Hosts]]

===== Encrypted Shared Folders with auto-mount =====
Follow this guide: [[deb9:encrypted|Encrypted partitions/folders with auto-mount]]

===== Links =====
  * [[https://www.sslshopper.com/ssl-checker.html|SSL Checker]]
  * [[https://www.synology.com/en-us/knowledgebase/DSM/tutorial/General/What_network_ports_are_used_by_Synology_services|Ports for Synology DSM]]
  * [[https://raid.wiki.kernel.org/index.php/Growing|Linux Raid Growing]]
  * [[http://www.ducea.com/2009/03/08/mdadm-cheat-sheet/|Mdadm Cheat Sheet]]
  * [[https://www.digitalocean.com/community/tutorials/how-to-manage-raid-arrays-with-mdadm-on-ubuntu-16-04|How To Manage RAID Arrays with mdadm on Ubuntu 16.04]]
  * [[https://sageadviceltd.com/how-to-run-fsck-on-a-synology-nas/|How to run fsck on a Synology NAS]]

===== Services and Packet Installation =====
  * [[:syno:ssh|SSH Access]]
  * [[:syno:ftp|FTP Access]]
  * [[syno:nfs|NFS Access]]
  * [[:syno:cl|Command Line]]
  * [[:syno:cloud|Cloud Station Server]]
  * [[:syno:notes|Note Station]]
  * [[:syno:carddav|CardDAV - Address Book]]
  * [[:syno:caldav|CalDAV - Calendar]]
  * [[:syno:thunderbird|Sync with Thunderbird - CardDAV & CalDAV]]
  * [[:syno:surveillance|Surveillance Station]]
  * [[:syno:photo|Photo Station]]
  * [[:syno:mailplus|MailPlus Server]]
  * [[syno:webstation|Web Station]]