• Deep reinforcement learning


    lecture 1 policy gradient Actor makes a decision action according to the environment state, and gets a reward after the decision Once a game becomes an epic, calculate the total reward of an epic trajectory tao = { s1,a1,s2,a2,….,sT,aT} P theta (tao) = p(s1)ptheta(a1|s1)p(s2|s1,a1)theta(a2|s2)… R (TAO) = total reward in one expectation gradient ascent Gradient […]

  • Looking for a sense of accomplishment in programming: which programming position is suitable for you?


    Each of us has unique talents, skills and interests. Finding a position that can give full play to these can bring us great motivation and sense of achievement. But often, we find ourselves in a very ordinary position, which leads to a vicious circle of job hopping, career change and dissatisfaction. If you want to […]

  • NFSv4 related; NFSv4 file lock


    This blog is about NFSv4 Operation reference: https://help.ubuntu.com/community/NFSv4Howto For NFS installation, refer to:https://www.cnblogs.com/xuyaowen/p/NFS_install.html NFSv4:https://linux.die.net/man/5/nfs  NFSv4 extended reading: https://www.snia.org/sites/default/files/SNIA_An_Overview_of_NFSv4-3_0.pdf https://www.netapp.com/us/media/tr-3580.pdf https://www.netapp.com/us/media/tr-4067.pdf In this paper, the operating system is as follows NAME=”Ubuntu” VERSION=”18.04.5 LTS (Bionic Beaver)” ID=ubuntu ID_LIKE=debian PRETTY_NAME=”Ubuntu 18.04.5 LTS” VERSION_ID=”18.04″ HOME_URL=”https://www.ubuntu.com/” SUPPORT_URL=”https://help.ubuntu.com/” BUG_REPORT_URL=”https://bugs.launchpad.net/ubuntu/” PRIVACY_POLICY_URL=”https://www.ubuntu.com/legal/terms-and-policies/privacy-policy” VERSION_CODENAME=bionic UBUNTU_CODENAME=bionic apt show -a nfs-common: ➜ ~ apt show -a […]

  • Use @ mockbean annotation


    Although the service layer is dependent on the persistence layer, the implementation logic of the persistence layer does not need to be considered when testing the service layer @Service public class EmployeeServiceImpl implements EmployeeService { @Autowired private EmployeeRepository employeeRepository; @Override public Employee getEmployeeByName(String name) { return employeeRepository.findByName(name); } } Ideally, when we test service code, […]

  • Primary analog circuit: an overview of 8-1 operational amplifier


    Back to the catalog       Operational amplifier(operational amplifier)Operational amplifier(OP AMP) is an integrated amplifier, which is characterized by a very large voltage gain (usually more than tens of thousands), high input impedance and low output impedance. The reason why the word “operation” should be added before its name is that the device was […]

  • Error book: constraintlayout cannot be displayed normally


    Ideal: Actual effect: Reason: because the constraint property of a control in the file is wrong This property isapp:layout_constraintLeft_toLeftOf=”@id/oa_setting_group_tv_add”Write yourself on your left. How to find: check one by one First, put the first control in another layout that is already in use, and display it normally; After using Tools > XML action > validate […]